2023-02-13 15:03:19,393 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-13 15:03:19,447 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=107, ProcessCount=165, AvailableMemoryMB=8640 2023-02-13 15:03:19,683 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d 2023-02-13 15:03:19,689 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 15:03:19,690 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed, deleteOnExit=true 2023-02-13 15:03:19,690 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 15:03:19,690 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/test.cache.data in system properties and HBase conf 2023-02-13 15:03:19,691 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 15:03:19,691 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop.log.dir in system properties and HBase conf 2023-02-13 15:03:19,691 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 15:03:19,692 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 15:03:19,692 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 15:03:19,767 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 15:03:20,075 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 15:03:20,080 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:20,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:20,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 15:03:20,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:20,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 15:03:20,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 15:03:20,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:20,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:20,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 15:03:20,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/nfs.dump.dir in system properties and HBase conf 2023-02-13 15:03:20,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/java.io.tmpdir in system properties and HBase conf 2023-02-13 15:03:20,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:20,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 15:03:20,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 15:03:20,515 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:20,519 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:20,736 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 15:03:20,916 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 15:03:20,937 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:20,984 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:21,027 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/java.io.tmpdir/Jetty_localhost_localdomain_39933_hdfs____.cjmpkj/webapp 2023-02-13 15:03:21,188 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:39933 2023-02-13 15:03:21,199 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:21,200 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:21,670 WARN [Listener at localhost.localdomain/40743] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:21,753 WARN [Listener at localhost.localdomain/40743] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:21,771 WARN [Listener at localhost.localdomain/40743] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:21,777 INFO [Listener at localhost.localdomain/40743] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:21,782 INFO [Listener at localhost.localdomain/40743] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/java.io.tmpdir/Jetty_localhost_35329_datanode____xz4xrz/webapp 2023-02-13 15:03:21,883 INFO [Listener at localhost.localdomain/40743] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35329 2023-02-13 15:03:22,319 WARN [Listener at localhost.localdomain/42339] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:22,353 WARN [Listener at localhost.localdomain/42339] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:22,357 WARN [Listener at localhost.localdomain/42339] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:22,359 INFO [Listener at localhost.localdomain/42339] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:22,367 INFO [Listener at localhost.localdomain/42339] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/java.io.tmpdir/Jetty_localhost_43195_datanode____.fqkl4b/webapp 2023-02-13 15:03:22,459 INFO [Listener at localhost.localdomain/42339] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43195 2023-02-13 15:03:22,481 WARN [Listener at localhost.localdomain/39751] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:22,720 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xebeb01f6105a190b: Processing first storage report for DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f from datanode 2f3cd2de-ad85-4444-85ac-4c7fb648da99 2023-02-13 15:03:22,721 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xebeb01f6105a190b: from storage DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f node DatanodeRegistration(127.0.0.1:37591, datanodeUuid=2f3cd2de-ad85-4444-85ac-4c7fb648da99, infoPort=37277, infoSecurePort=0, ipcPort=39751, storageInfo=lv=-57;cid=testClusterID;nsid=723607258;c=1676300600571), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 15:03:22,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d6a0fb65e6d4e33: Processing first storage report for DS-bf2c8e84-df80-4861-8df7-65eeecb825ec from datanode 97f85050-b3a9-4cb4-97e2-e77383b4f7a7 2023-02-13 15:03:22,721 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d6a0fb65e6d4e33: from storage DS-bf2c8e84-df80-4861-8df7-65eeecb825ec node DatanodeRegistration(127.0.0.1:36563, datanodeUuid=97f85050-b3a9-4cb4-97e2-e77383b4f7a7, infoPort=43111, infoSecurePort=0, ipcPort=42339, storageInfo=lv=-57;cid=testClusterID;nsid=723607258;c=1676300600571), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:22,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xebeb01f6105a190b: Processing first storage report for DS-369d3904-212e-43e0-9a73-094279abb6d7 from datanode 2f3cd2de-ad85-4444-85ac-4c7fb648da99 2023-02-13 15:03:22,721 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xebeb01f6105a190b: from storage DS-369d3904-212e-43e0-9a73-094279abb6d7 node DatanodeRegistration(127.0.0.1:37591, datanodeUuid=2f3cd2de-ad85-4444-85ac-4c7fb648da99, infoPort=37277, infoSecurePort=0, ipcPort=39751, storageInfo=lv=-57;cid=testClusterID;nsid=723607258;c=1676300600571), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 15:03:22,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d6a0fb65e6d4e33: Processing first storage report for DS-7d6fbea1-1f8f-432e-92e5-fa4f2c0d6ab9 from datanode 97f85050-b3a9-4cb4-97e2-e77383b4f7a7 2023-02-13 15:03:22,722 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d6a0fb65e6d4e33: from storage DS-7d6fbea1-1f8f-432e-92e5-fa4f2c0d6ab9 node DatanodeRegistration(127.0.0.1:36563, datanodeUuid=97f85050-b3a9-4cb4-97e2-e77383b4f7a7, infoPort=43111, infoSecurePort=0, ipcPort=42339, storageInfo=lv=-57;cid=testClusterID;nsid=723607258;c=1676300600571), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:22,833 DEBUG [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d 2023-02-13 15:03:22,928 INFO [Listener at localhost.localdomain/39751] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed/zookeeper_0, clientPort=53165, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 15:03:22,945 INFO [Listener at localhost.localdomain/39751] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53165 2023-02-13 15:03:22,952 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:22,954 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:23,591 INFO [Listener at localhost.localdomain/39751] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade with version=8 2023-02-13 15:03:23,592 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:23,593 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:23,597 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/hbase-staging 2023-02-13 15:03:23,868 INFO [Listener at localhost.localdomain/39751] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 15:03:24,257 INFO [Listener at localhost.localdomain/39751] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:24,284 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,284 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,284 INFO [Listener at localhost.localdomain/39751] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:24,284 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,285 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:24,406 INFO [Listener at localhost.localdomain/39751] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:24,468 DEBUG [Listener at localhost.localdomain/39751] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 15:03:24,545 INFO [Listener at localhost.localdomain/39751] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36165 2023-02-13 15:03:24,554 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:24,556 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:24,575 INFO [Listener at localhost.localdomain/39751] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36165 connecting to ZooKeeper ensemble=127.0.0.1:53165 2023-02-13 15:03:24,613 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:361650x0, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:24,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36165-0x1015c5d0fc00000 connected 2023-02-13 15:03:24,648 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:24,649 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:24,652 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:24,659 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36165 2023-02-13 15:03:24,659 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36165 2023-02-13 15:03:24,660 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36165 2023-02-13 15:03:24,661 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36165 2023-02-13 15:03:24,663 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36165 2023-02-13 15:03:24,669 INFO [Listener at localhost.localdomain/39751] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade, hbase.cluster.distributed=false 2023-02-13 15:03:24,734 INFO [Listener at localhost.localdomain/39751] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:24,734 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,734 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,734 INFO [Listener at localhost.localdomain/39751] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:24,735 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,735 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:24,739 INFO [Listener at localhost.localdomain/39751] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:24,742 INFO [Listener at localhost.localdomain/39751] ipc.NettyRpcServer(120): Bind to /148.251.75.209:32817 2023-02-13 15:03:24,745 INFO [Listener at localhost.localdomain/39751] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:24,752 DEBUG [Listener at localhost.localdomain/39751] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:24,753 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:24,755 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:24,757 INFO [Listener at localhost.localdomain/39751] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32817 connecting to ZooKeeper ensemble=127.0.0.1:53165 2023-02-13 15:03:24,760 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:328170x0, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:24,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32817-0x1015c5d0fc00001 connected 2023-02-13 15:03:24,761 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:24,762 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:24,763 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:24,764 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32817 2023-02-13 15:03:24,764 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32817 2023-02-13 15:03:24,767 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32817 2023-02-13 15:03:24,767 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32817 2023-02-13 15:03:24,767 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32817 2023-02-13 15:03:24,777 INFO [Listener at localhost.localdomain/39751] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:24,778 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,778 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,778 INFO [Listener at localhost.localdomain/39751] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:24,778 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:24,779 INFO [Listener at localhost.localdomain/39751] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:24,779 INFO [Listener at localhost.localdomain/39751] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:24,780 INFO [Listener at localhost.localdomain/39751] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34169 2023-02-13 15:03:24,781 INFO [Listener at localhost.localdomain/39751] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:24,783 DEBUG [Listener at localhost.localdomain/39751] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:24,784 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:24,786 INFO [Listener at localhost.localdomain/39751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:24,789 INFO [Listener at localhost.localdomain/39751] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34169 connecting to ZooKeeper ensemble=127.0.0.1:53165 2023-02-13 15:03:24,793 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:341690x0, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:24,794 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): regionserver:341690x0, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:24,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34169-0x1015c5d0fc00002 connected 2023-02-13 15:03:24,795 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:24,795 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ZKUtil(164): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:24,799 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34169 2023-02-13 15:03:24,799 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34169 2023-02-13 15:03:24,803 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34169 2023-02-13 15:03:24,804 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34169 2023-02-13 15:03:24,807 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34169 2023-02-13 15:03:24,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:24,817 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:24,818 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:24,842 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:24,842 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:24,842 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:24,843 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:24,844 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:24,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:24,845 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,36165,1676300603732 from backup master directory 2023-02-13 15:03:24,852 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:24,853 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:24,854 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:24,854 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:24,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 15:03:24,859 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 15:03:24,936 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/hbase.id with ID: cd3e6cd6-be45-4283-bc43-b5df4d17a9b4 2023-02-13 15:03:24,977 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:24,991 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:25,114 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4d6aa119 to 127.0.0.1:53165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:25,146 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@221a356b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:25,167 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:25,168 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 15:03:25,183 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 15:03:25,183 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 15:03:25,185 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 15:03:25,188 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 15:03:25,189 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:25,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store-tmp 2023-02-13 15:03:25,257 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:25,258 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:25,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:25,259 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:25,259 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:25,259 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:25,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:25,259 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300605258Disabling compacts and flushes for region at 1676300605258Disabling writes for close at 1676300605259 (+1 ms)Writing region close event to WAL at 1676300605259Closed at 1676300605259 2023-02-13 15:03:25,262 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/WALs/jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:25,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36165%2C1676300603732, suffix=, logDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/WALs/jenkins-hbase20.apache.org,36165,1676300603732, archiveDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/oldWALs, maxLogs=10 2023-02-13 15:03:25,336 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK] 2023-02-13 15:03:25,337 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK] 2023-02-13 15:03:25,344 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 15:03:25,407 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/WALs/jenkins-hbase20.apache.org,36165,1676300603732/jenkins-hbase20.apache.org%2C36165%2C1676300603732.1676300605291 2023-02-13 15:03:25,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK]] 2023-02-13 15:03:25,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:25,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:25,412 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:25,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:25,482 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:25,493 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 15:03:25,522 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 15:03:25,535 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:25,542 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:25,544 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:25,564 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:25,575 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:25,577 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61771109, jitterRate=-0.0795387476682663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:25,577 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676300605445Initializing all the Stores at 1676300605448 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300605449 (+1 ms)Cleaning up temporary data from old regions at 1676300605552 (+103 ms)Cleaning up detritus from prior splits at 1676300605554 (+2 ms)Region opened successfully at 1676300605577 (+23 ms) 2023-02-13 15:03:25,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 15:03:25,600 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 15:03:25,600 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 15:03:25,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 15:03:25,605 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 15:03:25,636 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-02-13 15:03:25,636 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 15:03:25,663 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 15:03:25,669 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 15:03:25,693 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 15:03:25,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 15:03:25,698 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 15:03:25,703 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 15:03:25,707 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 15:03:25,710 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:25,711 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 15:03:25,712 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 15:03:25,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 15:03:25,727 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:25,727 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:25,727 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:25,728 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:25,728 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,36165,1676300603732, sessionid=0x1015c5d0fc00000, setting cluster-up flag (Was=false) 2023-02-13 15:03:25,742 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:25,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 15:03:25,747 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:25,751 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:25,755 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 15:03:25,756 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:25,758 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.hbase-snapshot/.tmp 2023-02-13 15:03:25,810 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(952): ClusterId : cd3e6cd6-be45-4283-bc43-b5df4d17a9b4 2023-02-13 15:03:25,810 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(952): ClusterId : cd3e6cd6-be45-4283-bc43-b5df4d17a9b4 2023-02-13 15:03:25,818 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:25,818 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:25,824 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:25,824 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:25,825 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:25,825 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:25,828 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:25,828 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:25,829 DEBUG [RS:0;jenkins-hbase20:32817] zookeeper.ReadOnlyZKClient(139): Connect 0x47052887 to 127.0.0.1:53165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:25,829 DEBUG [RS:1;jenkins-hbase20:34169] zookeeper.ReadOnlyZKClient(139): Connect 0x6ad3a5ef to 127.0.0.1:53165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:25,838 DEBUG [RS:0;jenkins-hbase20:32817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e3b1f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:25,838 DEBUG [RS:1;jenkins-hbase20:34169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a09044, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:25,839 DEBUG [RS:1;jenkins-hbase20:34169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a84fb9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:25,839 DEBUG [RS:0;jenkins-hbase20:32817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d2dfc3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:25,859 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:34169 2023-02-13 15:03:25,863 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:32817 2023-02-13 15:03:25,864 INFO [RS:1;jenkins-hbase20:34169] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:25,864 INFO [RS:1;jenkins-hbase20:34169] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:25,864 INFO [RS:0;jenkins-hbase20:32817] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:25,864 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:25,865 INFO [RS:0;jenkins-hbase20:32817] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:25,865 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:25,867 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,36165,1676300603732 with isa=jenkins-hbase20.apache.org/148.251.75.209:34169, startcode=1676300604777 2023-02-13 15:03:25,867 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,36165,1676300603732 with isa=jenkins-hbase20.apache.org/148.251.75.209:32817, startcode=1676300604733 2023-02-13 15:03:25,889 DEBUG [RS:0;jenkins-hbase20:32817] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:25,889 DEBUG [RS:1;jenkins-hbase20:34169] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:25,897 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:25,909 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:25,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:25,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:25,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:25,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 15:03:25,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:25,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:25,911 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:25,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676300635916 2023-02-13 15:03:25,919 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 15:03:25,923 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:25,924 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 15:03:25,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 15:03:25,930 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:25,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 15:03:25,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 15:03:25,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 15:03:25,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 15:03:25,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:25,939 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 15:03:25,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 15:03:25,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 15:03:25,942 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38115, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:25,942 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45707, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:25,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 15:03:25,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 15:03:25,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:03:25,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36165] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:03:25,951 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300605949,5,FailOnTimeoutGroup] 2023-02-13 15:03:25,952 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300605952,5,FailOnTimeoutGroup] 2023-02-13 15:03:25,952 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:25,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 15:03:25,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:25,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:25,979 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:25,980 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:25,980 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade 2023-02-13 15:03:25,994 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(2829): Master is not running yet 2023-02-13 15:03:25,994 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(2829): Master is not running yet 2023-02-13 15:03:25,995 WARN [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-13 15:03:25,995 WARN [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-13 15:03:26,000 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:26,002 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:26,005 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/info 2023-02-13 15:03:26,006 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:26,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:26,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:26,009 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:26,010 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:26,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:26,011 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:26,013 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/table 2023-02-13 15:03:26,013 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:26,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:26,015 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740 2023-02-13 15:03:26,016 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740 2023-02-13 15:03:26,020 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:26,022 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:26,025 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:26,027 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74610992, jitterRate=0.11179041862487793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:26,027 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676300606000Initializing all the Stores at 1676300606002 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300606002Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300606002Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300606002Cleaning up temporary data from old regions at 1676300606018 (+16 ms)Cleaning up detritus from prior splits at 1676300606019 (+1 ms)Region opened successfully at 1676300606027 (+8 ms) 2023-02-13 15:03:26,027 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:26,027 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:26,027 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:26,027 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:26,027 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:26,028 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:26,029 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300606027Disabling compacts and flushes for region at 1676300606027Disabling writes for close at 1676300606027Writing region close event to WAL at 1676300606028 (+1 ms)Closed at 1676300606028 2023-02-13 15:03:26,034 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:26,034 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 15:03:26,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 15:03:26,053 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 15:03:26,056 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 15:03:26,207 WARN [jenkins-hbase20:36165] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-13 15:03:26,996 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,36165,1676300603732 with isa=jenkins-hbase20.apache.org/148.251.75.209:32817, startcode=1676300604733 2023-02-13 15:03:26,996 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,36165,1676300603732 with isa=jenkins-hbase20.apache.org/148.251.75.209:34169, startcode=1676300604777 2023-02-13 15:03:27,001 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36165] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,007 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade 2023-02-13 15:03:27,007 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40743 2023-02-13 15:03:27,008 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade 2023-02-13 15:03:27,008 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:27,008 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40743 2023-02-13 15:03:27,008 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:27,013 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:27,016 DEBUG [RS:0;jenkins-hbase20:32817] zookeeper.ZKUtil(162): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,016 WARN [RS:0;jenkins-hbase20:32817] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:27,016 DEBUG [RS:1;jenkins-hbase20:34169] zookeeper.ZKUtil(162): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,016 INFO [RS:0;jenkins-hbase20:32817] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:27,016 WARN [RS:1;jenkins-hbase20:34169] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:27,017 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,017 INFO [RS:1;jenkins-hbase20:34169] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:27,017 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,32817,1676300604733] 2023-02-13 15:03:27,017 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34169,1676300604777] 2023-02-13 15:03:27,017 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,028 DEBUG [RS:1;jenkins-hbase20:34169] zookeeper.ZKUtil(162): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,029 DEBUG [RS:1;jenkins-hbase20:34169] zookeeper.ZKUtil(162): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,031 DEBUG [RS:0;jenkins-hbase20:32817] zookeeper.ZKUtil(162): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,031 DEBUG [RS:0;jenkins-hbase20:32817] zookeeper.ZKUtil(162): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,041 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:27,041 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:27,050 INFO [RS:1;jenkins-hbase20:34169] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:27,050 INFO [RS:0;jenkins-hbase20:32817] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:27,073 INFO [RS:0;jenkins-hbase20:32817] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:27,073 INFO [RS:1;jenkins-hbase20:34169] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:27,077 INFO [RS:0;jenkins-hbase20:32817] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:27,077 INFO [RS:1;jenkins-hbase20:34169] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:27,078 INFO [RS:0;jenkins-hbase20:32817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,078 INFO [RS:1;jenkins-hbase20:34169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,079 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:27,079 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:27,087 INFO [RS:1;jenkins-hbase20:34169] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,087 INFO [RS:0;jenkins-hbase20:32817] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,087 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,087 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,088 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,088 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,088 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,088 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,088 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,088 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,088 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:27,089 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:27,089 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:1;jenkins-hbase20:34169] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,089 DEBUG [RS:0;jenkins-hbase20:32817] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:27,090 INFO [RS:1;jenkins-hbase20:34169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,091 INFO [RS:1;jenkins-hbase20:34169] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,091 INFO [RS:0;jenkins-hbase20:32817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,091 INFO [RS:1;jenkins-hbase20:34169] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,091 INFO [RS:0;jenkins-hbase20:32817] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,091 INFO [RS:0;jenkins-hbase20:32817] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,109 INFO [RS:1;jenkins-hbase20:34169] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:27,109 INFO [RS:0;jenkins-hbase20:32817] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:27,113 INFO [RS:0;jenkins-hbase20:32817] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32817,1676300604733-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,113 INFO [RS:1;jenkins-hbase20:34169] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34169,1676300604777-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,129 INFO [RS:0;jenkins-hbase20:32817] regionserver.Replication(203): jenkins-hbase20.apache.org,32817,1676300604733 started 2023-02-13 15:03:27,129 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,32817,1676300604733, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:32817, sessionid=0x1015c5d0fc00001 2023-02-13 15:03:27,129 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:27,129 DEBUG [RS:0;jenkins-hbase20:32817] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,130 DEBUG [RS:0;jenkins-hbase20:32817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32817,1676300604733' 2023-02-13 15:03:27,130 DEBUG [RS:0;jenkins-hbase20:32817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:27,135 INFO [RS:1;jenkins-hbase20:34169] regionserver.Replication(203): jenkins-hbase20.apache.org,34169,1676300604777 started 2023-02-13 15:03:27,135 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34169,1676300604777, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34169, sessionid=0x1015c5d0fc00002 2023-02-13 15:03:27,135 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:27,135 DEBUG [RS:1;jenkins-hbase20:34169] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,136 DEBUG [RS:0;jenkins-hbase20:32817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:27,136 DEBUG [RS:1;jenkins-hbase20:34169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34169,1676300604777' 2023-02-13 15:03:27,136 DEBUG [RS:1;jenkins-hbase20:34169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:27,137 DEBUG [RS:1;jenkins-hbase20:34169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:27,137 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:27,137 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:27,138 DEBUG [RS:0;jenkins-hbase20:32817] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,138 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:27,138 DEBUG [RS:0;jenkins-hbase20:32817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32817,1676300604733' 2023-02-13 15:03:27,138 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:27,138 DEBUG [RS:0;jenkins-hbase20:32817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:27,138 DEBUG [RS:1;jenkins-hbase20:34169] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,139 DEBUG [RS:1;jenkins-hbase20:34169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34169,1676300604777' 2023-02-13 15:03:27,139 DEBUG [RS:1;jenkins-hbase20:34169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:27,140 DEBUG [RS:1;jenkins-hbase20:34169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:27,140 DEBUG [RS:0;jenkins-hbase20:32817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:27,140 DEBUG [RS:0;jenkins-hbase20:32817] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:27,140 INFO [RS:0;jenkins-hbase20:32817] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:27,141 INFO [RS:0;jenkins-hbase20:32817] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:27,140 DEBUG [RS:1;jenkins-hbase20:34169] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:27,141 INFO [RS:1;jenkins-hbase20:34169] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:27,142 INFO [RS:1;jenkins-hbase20:34169] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:27,210 DEBUG [jenkins-hbase20:36165] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 15:03:27,214 DEBUG [jenkins-hbase20:36165] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:27,219 DEBUG [jenkins-hbase20:36165] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:27,219 DEBUG [jenkins-hbase20:36165] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:27,219 DEBUG [jenkins-hbase20:36165] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:27,222 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34169,1676300604777, state=OPENING 2023-02-13 15:03:27,231 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 15:03:27,232 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:27,233 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:27,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:27,420 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:27,422 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:27,425 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51678, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:27,437 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 15:03:27,438 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:27,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34169%2C1676300604777.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,34169,1676300604777, archiveDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/oldWALs, maxLogs=32 2023-02-13 15:03:27,459 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK] 2023-02-13 15:03:27,459 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK] 2023-02-13 15:03:27,464 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,34169,1676300604777/jenkins-hbase20.apache.org%2C34169%2C1676300604777.meta.1676300607444.meta 2023-02-13 15:03:27,467 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK]] 2023-02-13 15:03:27,467 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:27,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 15:03:27,482 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 15:03:27,487 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 15:03:27,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 15:03:27,492 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:27,492 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 15:03:27,492 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 15:03:27,494 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:27,496 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/info 2023-02-13 15:03:27,496 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/info 2023-02-13 15:03:27,497 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:27,498 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:27,498 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:27,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:27,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:27,501 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:27,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:27,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:27,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/table 2023-02-13 15:03:27,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/table 2023-02-13 15:03:27,504 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:27,505 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:27,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740 2023-02-13 15:03:27,511 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740 2023-02-13 15:03:27,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:27,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:27,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65765239, jitterRate=-0.020021572709083557}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:27,520 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676300607492Writing region info on filesystem at 1676300607492Initializing all the Stores at 1676300607494 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300607494Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300607494Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300607494Cleaning up temporary data from old regions at 1676300607513 (+19 ms)Cleaning up detritus from prior splits at 1676300607514 (+1 ms)Running coprocessor post-open hooks at 1676300607520 (+6 ms)Region opened successfully at 1676300607520 2023-02-13 15:03:27,529 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676300607414 2023-02-13 15:03:27,545 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 15:03:27,546 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 15:03:27,547 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34169,1676300604777, state=OPEN 2023-02-13 15:03:27,549 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 15:03:27,550 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:27,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 15:03:27,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34169,1676300604777 in 313 msec 2023-02-13 15:03:27,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 15:03:27,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5130 sec 2023-02-13 15:03:27,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7530 sec 2023-02-13 15:03:27,565 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676300604838, completionTime=-1 2023-02-13 15:03:27,566 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 15:03:27,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 15:03:27,624 DEBUG [hconnection-0x156b03e6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:27,627 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51692, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:27,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 15:03:27,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676300667646 2023-02-13 15:03:27,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676300727646 2023-02-13 15:03:27,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 80 msec 2023-02-13 15:03:27,672 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36165,1676300603732-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,672 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36165,1676300603732-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,672 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36165,1676300603732-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,673 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:36165, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,674 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:27,680 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 15:03:27,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 15:03:27,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:27,698 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 15:03:27,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:27,704 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:27,723 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:27,726 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3 empty. 2023-02-13 15:03:27,727 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:27,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 15:03:27,751 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:27,753 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d6e751fa185d76b0d3c831c155a18ab3, NAME => 'hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:27,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:27,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d6e751fa185d76b0d3c831c155a18ab3, disabling compactions & flushes 2023-02-13 15:03:27,769 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:27,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:27,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. after waiting 0 ms 2023-02-13 15:03:27,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:27,769 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:27,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d6e751fa185d76b0d3c831c155a18ab3: Waiting for close lock at 1676300607769Disabling compacts and flushes for region at 1676300607769Disabling writes for close at 1676300607769Writing region close event to WAL at 1676300607769Closed at 1676300607769 2023-02-13 15:03:27,774 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:27,786 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300607776"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300607776"}]},"ts":"1676300607776"} 2023-02-13 15:03:27,813 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:03:27,820 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:27,825 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300607820"}]},"ts":"1676300607820"} 2023-02-13 15:03:27,830 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 15:03:27,833 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:27,834 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:27,834 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:27,834 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:27,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d6e751fa185d76b0d3c831c155a18ab3, ASSIGN}] 2023-02-13 15:03:27,840 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d6e751fa185d76b0d3c831c155a18ab3, ASSIGN 2023-02-13 15:03:27,842 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d6e751fa185d76b0d3c831c155a18ab3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32817,1676300604733; forceNewPlan=false, retain=false 2023-02-13 15:03:27,994 INFO [jenkins-hbase20:36165] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:03:27,995 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d6e751fa185d76b0d3c831c155a18ab3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:27,995 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300607995"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300607995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300607995"}]},"ts":"1676300607995"} 2023-02-13 15:03:28,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d6e751fa185d76b0d3c831c155a18ab3, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:28,151 INFO [RS:0;jenkins-hbase20:32817] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C32817%2C1676300604733, suffix=, logDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,32817,1676300604733, archiveDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/oldWALs, maxLogs=32 2023-02-13 15:03:28,152 INFO [RS:1;jenkins-hbase20:34169] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34169%2C1676300604777, suffix=, logDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,34169,1676300604777, archiveDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/oldWALs, maxLogs=32 2023-02-13 15:03:28,154 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:28,154 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:28,157 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33754, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:28,164 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:28,176 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK] 2023-02-13 15:03:28,176 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK] 2023-02-13 15:03:28,178 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK] 2023-02-13 15:03:28,178 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK] 2023-02-13 15:03:28,183 INFO [RS:1;jenkins-hbase20:34169] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,34169,1676300604777/jenkins-hbase20.apache.org%2C34169%2C1676300604777.1676300608154 2023-02-13 15:03:28,183 INFO [RS:0;jenkins-hbase20:32817] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/WALs/jenkins-hbase20.apache.org,32817,1676300604733/jenkins-hbase20.apache.org%2C32817%2C1676300604733.1676300608154 2023-02-13 15:03:28,183 DEBUG [RS:1;jenkins-hbase20:34169] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK]] 2023-02-13 15:03:28,183 DEBUG [RS:0;jenkins-hbase20:32817] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37591,DS-0d25e09c-3e46-4f9c-bb89-de95e4553a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:36563,DS-bf2c8e84-df80-4861-8df7-65eeecb825ec,DISK]] 2023-02-13 15:03:28,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d6e751fa185d76b0d3c831c155a18ab3, NAME => 'hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:28,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:28,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,185 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:28,185 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:28,187 INFO [StoreOpener-d6e751fa185d76b0d3c831c155a18ab3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:28,193 DEBUG [StoreOpener-d6e751fa185d76b0d3c831c155a18ab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/info 2023-02-13 15:03:28,193 DEBUG [StoreOpener-d6e751fa185d76b0d3c831c155a18ab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/info 2023-02-13 15:03:28,194 INFO [StoreOpener-d6e751fa185d76b0d3c831c155a18ab3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6e751fa185d76b0d3c831c155a18ab3 columnFamilyName info 2023-02-13 15:03:28,195 INFO [StoreOpener-d6e751fa185d76b0d3c831c155a18ab3-1] regionserver.HStore(310): Store=d6e751fa185d76b0d3c831c155a18ab3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:28,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:28,203 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:28,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:28,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:28,234 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d6e751fa185d76b0d3c831c155a18ab3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70529889, jitterRate=0.05097724497318268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:28,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d6e751fa185d76b0d3c831c155a18ab3: Running coprocessor pre-open hook at 1676300608185Writing region info on filesystem at 1676300608185Initializing all the Stores at 1676300608186 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300608186Cleaning up temporary data from old regions at 1676300608204 (+18 ms)Cleaning up detritus from prior splits at 1676300608210 (+6 ms)Running coprocessor post-open hooks at 1676300608234 (+24 ms)Region opened successfully at 1676300608234 2023-02-13 15:03:28,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3., pid=6, masterSystemTime=1676300608154 2023-02-13 15:03:28,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:28,243 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:28,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d6e751fa185d76b0d3c831c155a18ab3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:28,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300608243"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300608243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300608243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300608243"}]},"ts":"1676300608243"} 2023-02-13 15:03:28,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 15:03:28,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d6e751fa185d76b0d3c831c155a18ab3, server=jenkins-hbase20.apache.org,32817,1676300604733 in 254 msec 2023-02-13 15:03:28,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 15:03:28,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d6e751fa185d76b0d3c831c155a18ab3, ASSIGN in 421 msec 2023-02-13 15:03:28,264 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:28,264 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300608264"}]},"ts":"1676300608264"} 2023-02-13 15:03:28,267 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 15:03:28,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:28,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 580 msec 2023-02-13 15:03:28,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 15:03:28,303 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:28,303 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:28,336 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:28,352 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33768, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:28,369 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 15:03:28,390 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:28,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-02-13 15:03:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 15:03:28,416 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:28,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-13 15:03:28,434 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 15:03:28,435 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 15:03:28,435 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.581sec 2023-02-13 15:03:28,438 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 15:03:28,440 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 15:03:28,440 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 15:03:28,441 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36165,1676300603732-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 15:03:28,442 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36165,1676300603732-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 15:03:28,450 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 15:03:28,521 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ReadOnlyZKClient(139): Connect 0x3dba84f6 to 127.0.0.1:53165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:28,525 DEBUG [Listener at localhost.localdomain/39751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f002dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:28,561 DEBUG [hconnection-0x5f8c2558-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:28,573 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51698, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:28,582 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:28,582 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 15:03:28,591 DEBUG [Listener at localhost.localdomain/39751] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 15:03:28,593 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 15:03:28,598 INFO [Listener at localhost.localdomain/39751] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 15:03:28,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-13 15:03:28,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:03:28,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 148.251.75.209:51740 deadline: 1676300668602, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 15:03:28,606 INFO [Listener at localhost.localdomain/39751] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 15:03:28,619 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:28,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 15:03:28,624 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:28,627 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:28,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 15:03:28,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:28,654 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:28,655 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b empty. 2023-02-13 15:03:28,655 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d empty. 2023-02-13 15:03:28,655 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252 empty. 2023-02-13 15:03:28,655 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e empty. 2023-02-13 15:03:28,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:28,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:28,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:28,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:28,658 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e empty. 2023-02-13 15:03:28,658 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a empty. 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce empty. 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693 empty. 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb empty. 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f empty. 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:28,660 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:28,659 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:28,660 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:28,660 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:28,660 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:28,660 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 15:03:28,680 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:28,682 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0757ff25434fd256d87f44bc8a24d25a, NAME => 'testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,682 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 644cc8d2fca28f19448afd0116f7096e, NAME => 'testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,682 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a0dd5d81ec4ea6ca6653c4055ae0a5ce, NAME => 'testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0757ff25434fd256d87f44bc8a24d25a, disabling compactions & flushes 2023-02-13 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a0dd5d81ec4ea6ca6653c4055ae0a5ce, disabling compactions & flushes 2023-02-13 15:03:28,743 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. after waiting 0 ms 2023-02-13 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:28,743 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:28,744 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: Waiting for close lock at 1676300608743Disabling compacts and flushes for region at 1676300608743Disabling writes for close at 1676300608743Writing region close event to WAL at 1676300608743Closed at 1676300608744 (+1 ms) 2023-02-13 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. after waiting 0 ms 2023-02-13 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:28,744 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0757ff25434fd256d87f44bc8a24d25a: Waiting for close lock at 1676300608743Disabling compacts and flushes for region at 1676300608743Disabling writes for close at 1676300608744 (+1 ms)Writing region close event to WAL at 1676300608744Closed at 1676300608744 2023-02-13 15:03:28,745 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7683b16f577bf67fd24f66bc0dc0597e, NAME => 'testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,745 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e3f636a3e94426a070b352ced6ac9e4d, NAME => 'testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 644cc8d2fca28f19448afd0116f7096e, disabling compactions & flushes 2023-02-13 15:03:28,745 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:28,746 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:28,746 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. after waiting 0 ms 2023-02-13 15:03:28,746 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:28,746 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:28,746 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 644cc8d2fca28f19448afd0116f7096e: Waiting for close lock at 1676300608745Disabling compacts and flushes for region at 1676300608745Disabling writes for close at 1676300608746 (+1 ms)Writing region close event to WAL at 1676300608746Closed at 1676300608746 2023-02-13 15:03:28,746 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 189cc975fd2f2560d5d2ef65ad524252, NAME => 'testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:28,797 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,799 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e3f636a3e94426a070b352ced6ac9e4d, disabling compactions & flushes 2023-02-13 15:03:28,803 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:28,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:28,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. after waiting 0 ms 2023-02-13 15:03:28,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:28,803 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:28,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e3f636a3e94426a070b352ced6ac9e4d: Waiting for close lock at 1676300608799Disabling compacts and flushes for region at 1676300608799Disabling writes for close at 1676300608803 (+4 ms)Writing region close event to WAL at 1676300608803Closed at 1676300608803 2023-02-13 15:03:28,804 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f82b0422a13fa7e1368d4266d0ffa03f, NAME => 'testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7683b16f577bf67fd24f66bc0dc0597e, disabling compactions & flushes 2023-02-13 15:03:28,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 189cc975fd2f2560d5d2ef65ad524252, disabling compactions & flushes 2023-02-13 15:03:28,811 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:28,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:28,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. after waiting 0 ms 2023-02-13 15:03:28,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:28,811 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:28,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 189cc975fd2f2560d5d2ef65ad524252: Waiting for close lock at 1676300608811Disabling compacts and flushes for region at 1676300608811Disabling writes for close at 1676300608811Writing region close event to WAL at 1676300608811Closed at 1676300608811 2023-02-13 15:03:28,810 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:28,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:28,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. after waiting 0 ms 2023-02-13 15:03:28,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:28,812 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:28,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7683b16f577bf67fd24f66bc0dc0597e: Waiting for close lock at 1676300608810Disabling compacts and flushes for region at 1676300608810Disabling writes for close at 1676300608812 (+2 ms)Writing region close event to WAL at 1676300608812Closed at 1676300608812 2023-02-13 15:03:28,813 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5a928f483bd149d990b76ca7b06d09fb, NAME => 'testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,813 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9ac0d2a60686cec63e9906124fbe168b, NAME => 'testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f82b0422a13fa7e1368d4266d0ffa03f, disabling compactions & flushes 2023-02-13 15:03:28,836 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:28,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:28,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. after waiting 0 ms 2023-02-13 15:03:28,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:28,836 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:28,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f82b0422a13fa7e1368d4266d0ffa03f: Waiting for close lock at 1676300608836Disabling compacts and flushes for region at 1676300608836Disabling writes for close at 1676300608836Writing region close event to WAL at 1676300608836Closed at 1676300608836 2023-02-13 15:03:28,837 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9d8058518fb19b4163360de6733e9693, NAME => 'testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp 2023-02-13 15:03:28,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:28,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9d8058518fb19b4163360de6733e9693, disabling compactions & flushes 2023-02-13 15:03:28,862 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:28,862 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:28,862 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. after waiting 0 ms 2023-02-13 15:03:28,862 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:28,862 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:28,862 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9d8058518fb19b4163360de6733e9693: Waiting for close lock at 1676300608861Disabling compacts and flushes for region at 1676300608861Disabling writes for close at 1676300608862 (+1 ms)Writing region close event to WAL at 1676300608862Closed at 1676300608862 2023-02-13 15:03:28,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:29,236 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,236 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5a928f483bd149d990b76ca7b06d09fb, disabling compactions & flushes 2023-02-13 15:03:29,236 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:29,236 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:29,236 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. after waiting 0 ms 2023-02-13 15:03:29,236 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:29,236 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:29,236 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5a928f483bd149d990b76ca7b06d09fb: Waiting for close lock at 1676300609236Disabling compacts and flushes for region at 1676300609236Disabling writes for close at 1676300609236Writing region close event to WAL at 1676300609236Closed at 1676300609236 2023-02-13 15:03:29,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9ac0d2a60686cec63e9906124fbe168b, disabling compactions & flushes 2023-02-13 15:03:29,239 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:29,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:29,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. after waiting 0 ms 2023-02-13 15:03:29,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:29,239 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:29,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9ac0d2a60686cec63e9906124fbe168b: Waiting for close lock at 1676300609239Disabling compacts and flushes for region at 1676300609239Disabling writes for close at 1676300609239Writing region close event to WAL at 1676300609239Closed at 1676300609239 2023-02-13 15:03:29,244 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:29,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,248 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,248 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300609246"}]},"ts":"1676300609246"} 2023-02-13 15:03:29,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:29,315 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 15:03:29,318 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:29,319 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300609318"}]},"ts":"1676300609318"} 2023-02-13 15:03:29,323 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 15:03:29,326 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:29,342 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:29,342 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:29,342 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:29,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=644cc8d2fca28f19448afd0116f7096e, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a0dd5d81ec4ea6ca6653c4055ae0a5ce, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0757ff25434fd256d87f44bc8a24d25a, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7683b16f577bf67fd24f66bc0dc0597e, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e3f636a3e94426a070b352ced6ac9e4d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=189cc975fd2f2560d5d2ef65ad524252, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f82b0422a13fa7e1368d4266d0ffa03f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ac0d2a60686cec63e9906124fbe168b, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5a928f483bd149d990b76ca7b06d09fb, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d8058518fb19b4163360de6733e9693, ASSIGN}] 2023-02-13 15:03:29,349 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=644cc8d2fca28f19448afd0116f7096e, ASSIGN 2023-02-13 15:03:29,349 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a0dd5d81ec4ea6ca6653c4055ae0a5ce, ASSIGN 2023-02-13 15:03:29,349 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0757ff25434fd256d87f44bc8a24d25a, ASSIGN 2023-02-13 15:03:29,349 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7683b16f577bf67fd24f66bc0dc0597e, ASSIGN 2023-02-13 15:03:29,351 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a0dd5d81ec4ea6ca6653c4055ae0a5ce, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34169,1676300604777; forceNewPlan=false, retain=false 2023-02-13 15:03:29,351 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=644cc8d2fca28f19448afd0116f7096e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34169,1676300604777; forceNewPlan=false, retain=false 2023-02-13 15:03:29,351 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0757ff25434fd256d87f44bc8a24d25a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32817,1676300604733; forceNewPlan=false, retain=false 2023-02-13 15:03:29,352 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7683b16f577bf67fd24f66bc0dc0597e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32817,1676300604733; forceNewPlan=false, retain=false 2023-02-13 15:03:29,352 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d8058518fb19b4163360de6733e9693, ASSIGN 2023-02-13 15:03:29,353 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f82b0422a13fa7e1368d4266d0ffa03f, ASSIGN 2023-02-13 15:03:29,353 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ac0d2a60686cec63e9906124fbe168b, ASSIGN 2023-02-13 15:03:29,353 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=189cc975fd2f2560d5d2ef65ad524252, ASSIGN 2023-02-13 15:03:29,353 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9d8058518fb19b4163360de6733e9693, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32817,1676300604733; forceNewPlan=false, retain=false 2023-02-13 15:03:29,353 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5a928f483bd149d990b76ca7b06d09fb, ASSIGN 2023-02-13 15:03:29,354 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f82b0422a13fa7e1368d4266d0ffa03f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34169,1676300604777; forceNewPlan=false, retain=false 2023-02-13 15:03:29,354 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9ac0d2a60686cec63e9906124fbe168b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32817,1676300604733; forceNewPlan=false, retain=false 2023-02-13 15:03:29,354 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5a928f483bd149d990b76ca7b06d09fb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34169,1676300604777; forceNewPlan=false, retain=false 2023-02-13 15:03:29,354 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=189cc975fd2f2560d5d2ef65ad524252, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34169,1676300604777; forceNewPlan=false, retain=false 2023-02-13 15:03:29,355 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e3f636a3e94426a070b352ced6ac9e4d, ASSIGN 2023-02-13 15:03:29,356 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e3f636a3e94426a070b352ced6ac9e4d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32817,1676300604733; forceNewPlan=false, retain=false 2023-02-13 15:03:29,502 INFO [jenkins-hbase20:36165] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 15:03:29,504 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=189cc975fd2f2560d5d2ef65ad524252, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,504 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=644cc8d2fca28f19448afd0116f7096e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,504 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a0dd5d81ec4ea6ca6653c4055ae0a5ce, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,504 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5a928f483bd149d990b76ca7b06d09fb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,504 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609504"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609504"}]},"ts":"1676300609504"} 2023-02-13 15:03:29,504 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300609504"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609504"}]},"ts":"1676300609504"} 2023-02-13 15:03:29,504 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609504"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609504"}]},"ts":"1676300609504"} 2023-02-13 15:03:29,504 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=f82b0422a13fa7e1368d4266d0ffa03f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,505 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609504"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609504"}]},"ts":"1676300609504"} 2023-02-13 15:03:29,504 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609504"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609504"}]},"ts":"1676300609504"} 2023-02-13 15:03:29,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 189cc975fd2f2560d5d2ef65ad524252, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:29,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 644cc8d2fca28f19448afd0116f7096e, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:29,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure 5a928f483bd149d990b76ca7b06d09fb, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:29,512 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure f82b0422a13fa7e1368d4266d0ffa03f, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:29,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0757ff25434fd256d87f44bc8a24d25a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,513 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609512"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609512"}]},"ts":"1676300609512"} 2023-02-13 15:03:29,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure a0dd5d81ec4ea6ca6653c4055ae0a5ce, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:29,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 0757ff25434fd256d87f44bc8a24d25a, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:29,515 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9d8058518fb19b4163360de6733e9693, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,516 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300609515"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609515"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609515"}]},"ts":"1676300609515"} 2023-02-13 15:03:29,517 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9ac0d2a60686cec63e9906124fbe168b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,517 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609517"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609517"}]},"ts":"1676300609517"} 2023-02-13 15:03:29,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 9d8058518fb19b4163360de6733e9693, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:29,519 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7683b16f577bf67fd24f66bc0dc0597e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,520 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609519"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609519"}]},"ts":"1676300609519"} 2023-02-13 15:03:29,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 9ac0d2a60686cec63e9906124fbe168b, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:29,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 7683b16f577bf67fd24f66bc0dc0597e, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:29,530 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e3f636a3e94426a070b352ced6ac9e4d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,531 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609530"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300609530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300609530"}]},"ts":"1676300609530"} 2023-02-13 15:03:29,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure e3f636a3e94426a070b352ced6ac9e4d, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:29,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:29,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a0dd5d81ec4ea6ca6653c4055ae0a5ce, NAME => 'testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 15:03:29,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,670 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,673 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1 2023-02-13 15:03:29,673 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1 2023-02-13 15:03:29,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:29,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9ac0d2a60686cec63e9906124fbe168b, NAME => 'testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 15:03:29,674 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0dd5d81ec4ea6ca6653c4055ae0a5ce columnFamilyName f1 2023-02-13 15:03:29,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,675 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(310): Store=a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,676 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,678 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,678 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2 2023-02-13 15:03:29,678 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2 2023-02-13 15:03:29,679 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0dd5d81ec4ea6ca6653c4055ae0a5ce columnFamilyName f2 2023-02-13 15:03:29,679 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(310): Store=a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,680 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1 2023-02-13 15:03:29,683 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1 2023-02-13 15:03:29,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,683 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ac0d2a60686cec63e9906124fbe168b columnFamilyName f1 2023-02-13 15:03:29,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,684 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(310): Store=9ac0d2a60686cec63e9906124fbe168b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,685 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:29,691 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2 2023-02-13 15:03:29,691 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2 2023-02-13 15:03:29,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,691 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ac0d2a60686cec63e9906124fbe168b columnFamilyName f2 2023-02-13 15:03:29,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened a0dd5d81ec4ea6ca6653c4055ae0a5ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64514584, jitterRate=-0.0386577844619751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,692 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(310): Store=9ac0d2a60686cec63e9906124fbe168b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: Running coprocessor pre-open hook at 1676300609668Writing region info on filesystem at 1676300609668Initializing all the Stores at 1676300609669 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609670 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609670Cleaning up temporary data from old regions at 1676300609685 (+15 ms)Cleaning up detritus from prior splits at 1676300609686 (+1 ms)Running coprocessor post-open hooks at 1676300609692 (+6 ms)Region opened successfully at 1676300609692 2023-02-13 15:03:29,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce., pid=25, masterSystemTime=1676300609660 2023-02-13 15:03:29,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:29,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:29,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:29,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 644cc8d2fca28f19448afd0116f7096e, NAME => 'testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 15:03:29,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,704 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,706 DEBUG [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f1 2023-02-13 15:03:29,706 DEBUG [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f1 2023-02-13 15:03:29,707 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a0dd5d81ec4ea6ca6653c4055ae0a5ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,707 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609703"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609703"}]},"ts":"1676300609703"} 2023-02-13 15:03:29,707 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 644cc8d2fca28f19448afd0116f7096e columnFamilyName f1 2023-02-13 15:03:29,710 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(310): Store=644cc8d2fca28f19448afd0116f7096e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,711 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:29,718 DEBUG [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f2 2023-02-13 15:03:29,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-13 15:03:29,718 DEBUG [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f2 2023-02-13 15:03:29,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure a0dd5d81ec4ea6ca6653c4055ae0a5ce, server=jenkins-hbase20.apache.org,34169,1676300604777 in 197 msec 2023-02-13 15:03:29,719 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 644cc8d2fca28f19448afd0116f7096e columnFamilyName f2 2023-02-13 15:03:29,720 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(310): Store=644cc8d2fca28f19448afd0116f7096e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a0dd5d81ec4ea6ca6653c4055ae0a5ce, ASSIGN in 376 msec 2023-02-13 15:03:29,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9ac0d2a60686cec63e9906124fbe168b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66750025, jitterRate=-0.005347117781639099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9ac0d2a60686cec63e9906124fbe168b: Running coprocessor pre-open hook at 1676300609675Writing region info on filesystem at 1676300609675Initializing all the Stores at 1676300609677 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609677Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609678 (+1 ms)Cleaning up temporary data from old regions at 1676300609698 (+20 ms)Cleaning up detritus from prior splits at 1676300609699 (+1 ms)Running coprocessor post-open hooks at 1676300609723 (+24 ms)Region opened successfully at 1676300609723 2023-02-13 15:03:29,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b., pid=28, masterSystemTime=1676300609668 2023-02-13 15:03:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:29,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:29,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:29,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0757ff25434fd256d87f44bc8a24d25a, NAME => 'testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 15:03:29,728 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9ac0d2a60686cec63e9906124fbe168b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,731 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609728"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609728"}]},"ts":"1676300609728"} 2023-02-13 15:03:29,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 644cc8d2fca28f19448afd0116f7096e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69484482, jitterRate=0.03539946675300598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 644cc8d2fca28f19448afd0116f7096e: Running coprocessor pre-open hook at 1676300609702Writing region info on filesystem at 1676300609702Initializing all the Stores at 1676300609704 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609704Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609704Cleaning up temporary data from old regions at 1676300609725 (+21 ms)Cleaning up detritus from prior splits at 1676300609725Running coprocessor post-open hooks at 1676300609739 (+14 ms)Region opened successfully at 1676300609739 2023-02-13 15:03:29,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e., pid=22, masterSystemTime=1676300609660 2023-02-13 15:03:29,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-13 15:03:29,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 9ac0d2a60686cec63e9906124fbe168b, server=jenkins-hbase20.apache.org,32817,1676300604733 in 212 msec 2023-02-13 15:03:29,744 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ac0d2a60686cec63e9906124fbe168b, ASSIGN in 399 msec 2023-02-13 15:03:29,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:29,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:29,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:29,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 189cc975fd2f2560d5d2ef65ad524252, NAME => 'testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 15:03:29,745 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=644cc8d2fca28f19448afd0116f7096e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,746 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300609745"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609745"}]},"ts":"1676300609745"} 2023-02-13 15:03:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,746 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1 2023-02-13 15:03:29,747 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1 2023-02-13 15:03:29,748 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0757ff25434fd256d87f44bc8a24d25a columnFamilyName f1 2023-02-13 15:03:29,749 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(310): Store=0757ff25434fd256d87f44bc8a24d25a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,749 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,751 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,753 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2 2023-02-13 15:03:29,753 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1 2023-02-13 15:03:29,753 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2 2023-02-13 15:03:29,753 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1 2023-02-13 15:03:29,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-13 15:03:29,755 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0757ff25434fd256d87f44bc8a24d25a columnFamilyName f2 2023-02-13 15:03:29,755 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 189cc975fd2f2560d5d2ef65ad524252 columnFamilyName f1 2023-02-13 15:03:29,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 644cc8d2fca28f19448afd0116f7096e, server=jenkins-hbase20.apache.org,34169,1676300604777 in 240 msec 2023-02-13 15:03:29,756 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(310): Store=189cc975fd2f2560d5d2ef65ad524252/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,756 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,757 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(310): Store=0757ff25434fd256d87f44bc8a24d25a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,760 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2 2023-02-13 15:03:29,760 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2 2023-02-13 15:03:29,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:29,761 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 189cc975fd2f2560d5d2ef65ad524252 columnFamilyName f2 2023-02-13 15:03:29,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=644cc8d2fca28f19448afd0116f7096e, ASSIGN in 413 msec 2023-02-13 15:03:29,762 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(310): Store=189cc975fd2f2560d5d2ef65ad524252/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:29,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:29,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 0757ff25434fd256d87f44bc8a24d25a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68599917, jitterRate=0.02221842110157013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 0757ff25434fd256d87f44bc8a24d25a: Running coprocessor pre-open hook at 1676300609732Writing region info on filesystem at 1676300609732Initializing all the Stores at 1676300609743 (+11 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609743Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609744 (+1 ms)Cleaning up temporary data from old regions at 1676300609761 (+17 ms)Cleaning up detritus from prior splits at 1676300609764 (+3 ms)Running coprocessor post-open hooks at 1676300609773 (+9 ms)Region opened successfully at 1676300609773 2023-02-13 15:03:29,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 189cc975fd2f2560d5d2ef65ad524252; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60189293, jitterRate=-0.10310964286327362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 189cc975fd2f2560d5d2ef65ad524252: Running coprocessor pre-open hook at 1676300609746Writing region info on filesystem at 1676300609746Initializing all the Stores at 1676300609749 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609749Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609749Cleaning up temporary data from old regions at 1676300609767 (+18 ms)Cleaning up detritus from prior splits at 1676300609768 (+1 ms)Running coprocessor post-open hooks at 1676300609774 (+6 ms)Region opened successfully at 1676300609774 2023-02-13 15:03:29,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a., pid=26, masterSystemTime=1676300609668 2023-02-13 15:03:29,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252., pid=21, masterSystemTime=1676300609660 2023-02-13 15:03:29,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:29,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0757ff25434fd256d87f44bc8a24d25a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609778"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609778"}]},"ts":"1676300609778"} 2023-02-13 15:03:29,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:29,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:29,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:29,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:29,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:29,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e3f636a3e94426a070b352ced6ac9e4d, NAME => 'testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 15:03:29,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5a928f483bd149d990b76ca7b06d09fb, NAME => 'testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 15:03:29,779 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=189cc975fd2f2560d5d2ef65ad524252, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,779 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609779"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609779"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609779"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609779"}]},"ts":"1676300609779"} 2023-02-13 15:03:29,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-13 15:03:29,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 0757ff25434fd256d87f44bc8a24d25a, server=jenkins-hbase20.apache.org,32817,1676300604733 in 266 msec 2023-02-13 15:03:29,786 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,786 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-13 15:03:29,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 189cc975fd2f2560d5d2ef65ad524252, server=jenkins-hbase20.apache.org,34169,1676300604777 in 276 msec 2023-02-13 15:03:29,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0757ff25434fd256d87f44bc8a24d25a, ASSIGN in 443 msec 2023-02-13 15:03:29,789 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1 2023-02-13 15:03:29,789 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1 2023-02-13 15:03:29,789 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1 2023-02-13 15:03:29,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=189cc975fd2f2560d5d2ef65ad524252, ASSIGN in 445 msec 2023-02-13 15:03:29,789 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3f636a3e94426a070b352ced6ac9e4d columnFamilyName f1 2023-02-13 15:03:29,789 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1 2023-02-13 15:03:29,790 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a928f483bd149d990b76ca7b06d09fb columnFamilyName f1 2023-02-13 15:03:29,790 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(310): Store=e3f636a3e94426a070b352ced6ac9e4d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,790 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,790 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(310): Store=5a928f483bd149d990b76ca7b06d09fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,790 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,792 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2 2023-02-13 15:03:29,792 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2 2023-02-13 15:03:29,792 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2 2023-02-13 15:03:29,792 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2 2023-02-13 15:03:29,792 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a928f483bd149d990b76ca7b06d09fb columnFamilyName f2 2023-02-13 15:03:29,792 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3f636a3e94426a070b352ced6ac9e4d columnFamilyName f2 2023-02-13 15:03:29,793 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(310): Store=5a928f483bd149d990b76ca7b06d09fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,793 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(310): Store=e3f636a3e94426a070b352ced6ac9e4d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:29,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:29,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5a928f483bd149d990b76ca7b06d09fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71998162, jitterRate=0.07285621762275696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5a928f483bd149d990b76ca7b06d09fb: Running coprocessor pre-open hook at 1676300609782Writing region info on filesystem at 1676300609782Initializing all the Stores at 1676300609784 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609784Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609785 (+1 ms)Cleaning up temporary data from old regions at 1676300609797 (+12 ms)Cleaning up detritus from prior splits at 1676300609798 (+1 ms)Running coprocessor post-open hooks at 1676300609805 (+7 ms)Region opened successfully at 1676300609805 2023-02-13 15:03:29,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e3f636a3e94426a070b352ced6ac9e4d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59627842, jitterRate=-0.11147591471672058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e3f636a3e94426a070b352ced6ac9e4d: Running coprocessor pre-open hook at 1676300609781Writing region info on filesystem at 1676300609781Initializing all the Stores at 1676300609785 (+4 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609785Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609785Cleaning up temporary data from old regions at 1676300609797 (+12 ms)Cleaning up detritus from prior splits at 1676300609798 (+1 ms)Running coprocessor post-open hooks at 1676300609806 (+8 ms)Region opened successfully at 1676300609806 2023-02-13 15:03:29,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d., pid=30, masterSystemTime=1676300609668 2023-02-13 15:03:29,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb., pid=23, masterSystemTime=1676300609660 2023-02-13 15:03:29,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:29,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:29,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:29,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9d8058518fb19b4163360de6733e9693, NAME => 'testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 15:03:29,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,819 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e3f636a3e94426a070b352ced6ac9e4d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,819 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609819"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609819"}]},"ts":"1676300609819"} 2023-02-13 15:03:29,821 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5a928f483bd149d990b76ca7b06d09fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,821 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609821"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609821"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609821"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609821"}]},"ts":"1676300609821"} 2023-02-13 15:03:29,821 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:29,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:29,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:29,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f82b0422a13fa7e1368d4266d0ffa03f, NAME => 'testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 15:03:29,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,825 DEBUG [StoreOpener-9d8058518fb19b4163360de6733e9693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f1 2023-02-13 15:03:29,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,825 DEBUG [StoreOpener-9d8058518fb19b4163360de6733e9693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f1 2023-02-13 15:03:29,826 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d8058518fb19b4163360de6733e9693 columnFamilyName f1 2023-02-13 15:03:29,827 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(310): Store=9d8058518fb19b4163360de6733e9693/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,827 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-13 15:03:29,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure e3f636a3e94426a070b352ced6ac9e4d, server=jenkins-hbase20.apache.org,32817,1676300604733 in 289 msec 2023-02-13 15:03:29,829 DEBUG [StoreOpener-9d8058518fb19b4163360de6733e9693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f2 2023-02-13 15:03:29,830 DEBUG [StoreOpener-9d8058518fb19b4163360de6733e9693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f2 2023-02-13 15:03:29,830 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d8058518fb19b4163360de6733e9693 columnFamilyName f2 2023-02-13 15:03:29,831 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,831 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(310): Store=9d8058518fb19b4163360de6733e9693/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,833 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1 2023-02-13 15:03:29,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,835 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1 2023-02-13 15:03:29,836 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f82b0422a13fa7e1368d4266d0ffa03f columnFamilyName f1 2023-02-13 15:03:29,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-13 15:03:29,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure 5a928f483bd149d990b76ca7b06d09fb, server=jenkins-hbase20.apache.org,34169,1676300604777 in 313 msec 2023-02-13 15:03:29,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e3f636a3e94426a070b352ced6ac9e4d, ASSIGN in 485 msec 2023-02-13 15:03:29,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5a928f483bd149d990b76ca7b06d09fb, ASSIGN in 495 msec 2023-02-13 15:03:29,840 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(310): Store=f82b0422a13fa7e1368d4266d0ffa03f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,840 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:29,841 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2 2023-02-13 15:03:29,841 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2 2023-02-13 15:03:29,842 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f82b0422a13fa7e1368d4266d0ffa03f columnFamilyName f2 2023-02-13 15:03:29,843 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(310): Store=f82b0422a13fa7e1368d4266d0ffa03f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9d8058518fb19b4163360de6733e9693; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66793489, jitterRate=-0.004699453711509705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9d8058518fb19b4163360de6733e9693: Running coprocessor pre-open hook at 1676300609819Writing region info on filesystem at 1676300609819Initializing all the Stores at 1676300609820 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609821 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609821Cleaning up temporary data from old regions at 1676300609836 (+15 ms)Cleaning up detritus from prior splits at 1676300609836Running coprocessor post-open hooks at 1676300609845 (+9 ms)Region opened successfully at 1676300609845 2023-02-13 15:03:29,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693., pid=27, masterSystemTime=1676300609668 2023-02-13 15:03:29,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:29,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:29,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:29,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7683b16f577bf67fd24f66bc0dc0597e, NAME => 'testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 15:03:29,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:29,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:29,850 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9d8058518fb19b4163360de6733e9693, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300609850"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609850"}]},"ts":"1676300609850"} 2023-02-13 15:03:29,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,864 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f82b0422a13fa7e1368d4266d0ffa03f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70726563, jitterRate=0.05390791594982147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f82b0422a13fa7e1368d4266d0ffa03f: Running coprocessor pre-open hook at 1676300609825Writing region info on filesystem at 1676300609825Initializing all the Stores at 1676300609827 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609827Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609831 (+4 ms)Cleaning up temporary data from old regions at 1676300609846 (+15 ms)Cleaning up detritus from prior splits at 1676300609846Running coprocessor post-open hooks at 1676300609864 (+18 ms)Region opened successfully at 1676300609864 2023-02-13 15:03:29,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f., pid=24, masterSystemTime=1676300609660 2023-02-13 15:03:29,867 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1 2023-02-13 15:03:29,867 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1 2023-02-13 15:03:29,868 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7683b16f577bf67fd24f66bc0dc0597e columnFamilyName f1 2023-02-13 15:03:29,869 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(310): Store=7683b16f577bf67fd24f66bc0dc0597e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,870 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-13 15:03:29,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 9d8058518fb19b4163360de6733e9693, server=jenkins-hbase20.apache.org,32817,1676300604733 in 342 msec 2023-02-13 15:03:29,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:29,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:29,872 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2 2023-02-13 15:03:29,872 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=f82b0422a13fa7e1368d4266d0ffa03f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:29,872 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2 2023-02-13 15:03:29,872 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609872"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609872"}]},"ts":"1676300609872"} 2023-02-13 15:03:29,873 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7683b16f577bf67fd24f66bc0dc0597e columnFamilyName f2 2023-02-13 15:03:29,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9d8058518fb19b4163360de6733e9693, ASSIGN in 529 msec 2023-02-13 15:03:29,874 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(310): Store=7683b16f577bf67fd24f66bc0dc0597e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:29,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:29,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-13 15:03:29,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure f82b0422a13fa7e1368d4266d0ffa03f, server=jenkins-hbase20.apache.org,34169,1676300604777 in 364 msec 2023-02-13 15:03:29,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:29,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f82b0422a13fa7e1368d4266d0ffa03f, ASSIGN in 539 msec 2023-02-13 15:03:29,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:29,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7683b16f577bf67fd24f66bc0dc0597e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64137704, jitterRate=-0.0442737340927124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:29,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7683b16f577bf67fd24f66bc0dc0597e: Running coprocessor pre-open hook at 1676300609850Writing region info on filesystem at 1676300609850Initializing all the Stores at 1676300609855 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609855Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300609863 (+8 ms)Cleaning up temporary data from old regions at 1676300609879 (+16 ms)Cleaning up detritus from prior splits at 1676300609879Running coprocessor post-open hooks at 1676300609887 (+8 ms)Region opened successfully at 1676300609887 2023-02-13 15:03:29,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e., pid=29, masterSystemTime=1676300609668 2023-02-13 15:03:29,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:29,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:29,891 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7683b16f577bf67fd24f66bc0dc0597e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:29,892 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300609891"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300609891"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300609891"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300609891"}]},"ts":"1676300609891"} 2023-02-13 15:03:29,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-13 15:03:29,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 7683b16f577bf67fd24f66bc0dc0597e, server=jenkins-hbase20.apache.org,32817,1676300604733 in 370 msec 2023-02-13 15:03:29,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-13 15:03:29,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7683b16f577bf67fd24f66bc0dc0597e, ASSIGN in 557 msec 2023-02-13 15:03:29,903 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:29,904 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300609903"}]},"ts":"1676300609903"} 2023-02-13 15:03:29,906 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 15:03:29,909 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:29,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2900 sec 2023-02-13 15:03:30,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:30,764 INFO [Listener at localhost.localdomain/39751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 15:03:30,764 DEBUG [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 15:03:30,765 INFO [Listener at localhost.localdomain/39751] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:30,775 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 15:03:30,775 INFO [Listener at localhost.localdomain/39751] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:30,776 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 15:03:30,776 INFO [Listener at localhost.localdomain/39751] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 15:03:30,892 DEBUG [hconnection-0x5f8c2558-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:30,926 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33772, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:30,957 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:30,958 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34169] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:31,186 INFO [Listener at localhost.localdomain/39751] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 15:03:31,189 INFO [Listener at localhost.localdomain/39751] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 15:03:31,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:03:31,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676300611200 (current time:1676300611200). 2023-02-13 15:03:31,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 15:03:31,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] zookeeper.ReadOnlyZKClient(139): Connect 0x30076b7e to 127.0.0.1:53165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:31,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5be69c03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:31,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:31,214 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:31,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30076b7e to 127.0.0.1:53165 2023-02-13 15:03:31,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:31,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 15:03:31,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:03:31,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:03:31,237 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:03:31,238 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676301211238 2023-02-13 15:03:31,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:03:31,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 15:03:31,241 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:03:31,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:03:31,244 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 11 msec 2023-02-13 15:03:31,244 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:03:31,245 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:31,245 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 15:03:31,246 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676301211246 2023-02-13 15:03:31,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-13 15:03:31,274 INFO [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-13 15:03:31,274 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:31,275 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-13 15:03:31,275 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 15:03:31,275 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:31,275 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 15:03:31,276 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:31,276 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:31,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:31,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:31,277 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 15:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 15:03:31,277 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,278 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:31,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:31,278 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 15:03:31,278 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 15:03:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 15:03:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 15:03:31,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 15:03:31,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 15:03:31,281 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 15:03:31,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 15:03:31,283 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 15:03:31,283 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:31,287 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 15:03:31,287 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 15:03:31,287 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 15:03:31,287 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:31,287 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32817,1676300604733' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 15:03:31,288 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 15:03:31,288 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 15:03:31,288 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34169,1676300604777' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 15:03:31,291 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,291 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,292 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:31,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:31,292 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,292 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:31,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:31,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:31,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:31,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:31,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34169,1676300604777' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 15:03:31,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@533b48dd[Count = 1] remaining members to acquire global barrier 2023-02-13 15:03:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:31,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:31,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:31,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32817,1676300604733' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 15:03:31,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@533b48dd[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:31,297 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 15:03:31,297 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,299 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,299 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:31,300 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,300 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,300 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:31,301 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:31,301 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. started... 2023-02-13 15:03:31,303 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,303 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:31,303 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 189cc975fd2f2560d5d2ef65ad524252 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:31,303 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. started... 2023-02-13 15:03:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 15:03:31,307 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:31,307 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a0dd5d81ec4ea6ca6653c4055ae0a5ce 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 15:03:31,307 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. started... 2023-02-13 15:03:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:03:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,309 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:31,309 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:31,309 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:31,309 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:31,309 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. started... 2023-02-13 15:03:31,310 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 644cc8d2fca28f19448afd0116f7096e: 2023-02-13 15:03:31,311 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0757ff25434fd256d87f44bc8a24d25a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:31,311 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:31,311 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,311 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. started... 2023-02-13 15:03:31,315 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 15:03:31,315 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:03:31,315 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:31,315 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. started... 2023-02-13 15:03:31,316 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9ac0d2a60686cec63e9906124fbe168b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:31,316 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e3f636a3e94426a070b352ced6ac9e4d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:31,317 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:31,324 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:31,324 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:31,345 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:31,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:31,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:31,354 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 15:03:31,355 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. completed. 2023-02-13 15:03:31,355 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:31,359 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:31,359 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 15:03:31,359 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. started... 2023-02-13 15:03:31,360 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5a928f483bd149d990b76ca7b06d09fb 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 15:03:31,486 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f1/c3c28e4e516f4f2a8e50403d022cc04f 2023-02-13 15:03:31,492 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f1/a88eb4542d1c468992d74a700243881d 2023-02-13 15:03:31,492 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f1/1af4bf7eeb5a4f359b82cc8c228b826f 2023-02-13 15:03:31,492 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f1/21421429f4814699badd4498745e5c12 2023-02-13 15:03:31,493 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f1/a3d8f512a24942ea880404331a39e0ff 2023-02-13 15:03:31,564 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:31,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:31,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:31,566 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 15:03:31,595 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f2/bd5400237aba485ebaba4d3dce97e552 2023-02-13 15:03:31,605 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f2/a7e2ebd9e117467199cd40185420df58 2023-02-13 15:03:31,608 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f2/d4fcb8320960405893d17c87933ac9c4 2023-02-13 15:03:31,609 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f1/a3d8f512a24942ea880404331a39e0ff as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/a3d8f512a24942ea880404331a39e0ff 2023-02-13 15:03:31,617 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f1/1af4bf7eeb5a4f359b82cc8c228b826f as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/1af4bf7eeb5a4f359b82cc8c228b826f 2023-02-13 15:03:31,621 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f1/21421429f4814699badd4498745e5c12 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/21421429f4814699badd4498745e5c12 2023-02-13 15:03:31,630 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/a3d8f512a24942ea880404331a39e0ff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,632 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/21421429f4814699badd4498745e5c12, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,635 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f2/d4fcb8320960405893d17c87933ac9c4 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/d4fcb8320960405893d17c87933ac9c4 2023-02-13 15:03:31,635 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/1af4bf7eeb5a4f359b82cc8c228b826f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,635 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f2/bd5400237aba485ebaba4d3dce97e552 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/bd5400237aba485ebaba4d3dce97e552 2023-02-13 15:03:31,639 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f2/a7e2ebd9e117467199cd40185420df58 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/a7e2ebd9e117467199cd40185420df58 2023-02-13 15:03:31,646 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/d4fcb8320960405893d17c87933ac9c4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,648 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 189cc975fd2f2560d5d2ef65ad524252 in 345ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:31,650 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 15:03:31,654 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 189cc975fd2f2560d5d2ef65ad524252: 2023-02-13 15:03:31,654 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,654 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:31,654 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/bd5400237aba485ebaba4d3dce97e552, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,655 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/21421429f4814699badd4498745e5c12] hfiles 2023-02-13 15:03:31,655 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/21421429f4814699badd4498745e5c12 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,656 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9ac0d2a60686cec63e9906124fbe168b in 341ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:31,660 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/a7e2ebd9e117467199cd40185420df58, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,661 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9ac0d2a60686cec63e9906124fbe168b: 2023-02-13 15:03:31,661 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0757ff25434fd256d87f44bc8a24d25a in 350ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:31,661 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,661 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0757ff25434fd256d87f44bc8a24d25a: 2023-02-13 15:03:31,661 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:31,662 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/a3d8f512a24942ea880404331a39e0ff] hfiles 2023-02-13 15:03:31,662 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/a3d8f512a24942ea880404331a39e0ff for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,662 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,662 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:31,662 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/1af4bf7eeb5a4f359b82cc8c228b826f] hfiles 2023-02-13 15:03:31,662 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/1af4bf7eeb5a4f359b82cc8c228b826f for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,664 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/d4fcb8320960405893d17c87933ac9c4] hfiles 2023-02-13 15:03:31,664 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/a7e2ebd9e117467199cd40185420df58] hfiles 2023-02-13 15:03:31,664 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/bd5400237aba485ebaba4d3dce97e552] hfiles 2023-02-13 15:03:31,664 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/a7e2ebd9e117467199cd40185420df58 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,664 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/d4fcb8320960405893d17c87933ac9c4 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,664 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/bd5400237aba485ebaba4d3dce97e552 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,700 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. completed. 2023-02-13 15:03:31,700 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:31,702 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:31,702 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 15:03:31,702 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. completed. 2023-02-13 15:03:31,702 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. started... 2023-02-13 15:03:31,703 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:31,703 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 15:03:31,703 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:31,704 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. started... 2023-02-13 15:03:31,704 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7683b16f577bf67fd24f66bc0dc0597e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:31,704 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9d8058518fb19b4163360de6733e9693: 2023-02-13 15:03:31,705 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,705 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:31,705 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:31,705 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:31,711 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. completed. 2023-02-13 15:03:31,712 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:31,712 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:31,712 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 15:03:31,712 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. started... 2023-02-13 15:03:31,713 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f82b0422a13fa7e1368d4266d0ffa03f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:31,735 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. completed. 2023-02-13 15:03:31,735 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:31,735 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 15:03:31,744 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f1/5cadc0d064984ee9878314a89540210d 2023-02-13 15:03:31,769 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f2/6c74514479fa4d0284eae2b53e1ae4c1 2023-02-13 15:03:31,777 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f1/5cadc0d064984ee9878314a89540210d as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/5cadc0d064984ee9878314a89540210d 2023-02-13 15:03:31,785 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/5cadc0d064984ee9878314a89540210d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,787 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f2/6c74514479fa4d0284eae2b53e1ae4c1 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/6c74514479fa4d0284eae2b53e1ae4c1 2023-02-13 15:03:31,794 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/6c74514479fa4d0284eae2b53e1ae4c1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,795 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7683b16f577bf67fd24f66bc0dc0597e in 91ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:31,795 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7683b16f577bf67fd24f66bc0dc0597e: 2023-02-13 15:03:31,796 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,796 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:31,796 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/5cadc0d064984ee9878314a89540210d] hfiles 2023-02-13 15:03:31,796 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/5cadc0d064984ee9878314a89540210d for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,796 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/6c74514479fa4d0284eae2b53e1ae4c1] hfiles 2023-02-13 15:03:31,796 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/6c74514479fa4d0284eae2b53e1ae4c1 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,805 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. completed. 2023-02-13 15:03:31,805 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:31,805 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 15:03:31,866 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:31,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:31,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:31,868 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 15:03:31,893 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f1/973ff68cf6804868b6cb5fd23fbbec23 2023-02-13 15:03:31,921 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f2/61ef4413d599404da977550f351ae332 2023-02-13 15:03:31,931 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f1/973ff68cf6804868b6cb5fd23fbbec23 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/973ff68cf6804868b6cb5fd23fbbec23 2023-02-13 15:03:31,944 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/973ff68cf6804868b6cb5fd23fbbec23, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,946 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f2/61ef4413d599404da977550f351ae332 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/61ef4413d599404da977550f351ae332 2023-02-13 15:03:31,958 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/61ef4413d599404da977550f351ae332, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:31,959 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e3f636a3e94426a070b352ced6ac9e4d in 643ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:31,960 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e3f636a3e94426a070b352ced6ac9e4d: 2023-02-13 15:03:31,961 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,961 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:31,961 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/973ff68cf6804868b6cb5fd23fbbec23] hfiles 2023-02-13 15:03:31,961 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/973ff68cf6804868b6cb5fd23fbbec23 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,961 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/61ef4413d599404da977550f351ae332] hfiles 2023-02-13 15:03:31,961 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/61ef4413d599404da977550f351ae332 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:31,973 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. completed. 2023-02-13 15:03:31,973 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:31,974 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 15:03:31,974 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 15:03:31,974 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,974 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 15:03:31,974 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,32817,1676300604733' in zk 2023-02-13 15:03:31,976 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 15:03:31,976 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,976 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:31,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:31,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:31,976 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 15:03:31,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:31,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:31,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:31,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:31,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,32817,1676300604733': 2023-02-13 15:03:31,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32817,1676300604733' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 15:03:31,995 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f2/347d2fcfafef447d87f6aa6e144f09ea 2023-02-13 15:03:31,995 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f2/0f28189932154d9b917d46096ca863ea 2023-02-13 15:03:32,002 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f1/c3c28e4e516f4f2a8e50403d022cc04f as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/c3c28e4e516f4f2a8e50403d022cc04f 2023-02-13 15:03:32,002 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f1/a88eb4542d1c468992d74a700243881d as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/a88eb4542d1c468992d74a700243881d 2023-02-13 15:03:32,008 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/a88eb4542d1c468992d74a700243881d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:32,008 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/c3c28e4e516f4f2a8e50403d022cc04f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:32,009 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f2/0f28189932154d9b917d46096ca863ea as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/0f28189932154d9b917d46096ca863ea 2023-02-13 15:03:32,009 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f2/347d2fcfafef447d87f6aa6e144f09ea as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/347d2fcfafef447d87f6aa6e144f09ea 2023-02-13 15:03:32,021 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/347d2fcfafef447d87f6aa6e144f09ea, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:32,022 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/0f28189932154d9b917d46096ca863ea, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:32,023 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for a0dd5d81ec4ea6ca6653c4055ae0a5ce in 715ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:32,023 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: 2023-02-13 15:03:32,023 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,023 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:32,023 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/a88eb4542d1c468992d74a700243881d] hfiles 2023-02-13 15:03:32,023 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/a88eb4542d1c468992d74a700243881d for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,023 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/347d2fcfafef447d87f6aa6e144f09ea] hfiles 2023-02-13 15:03:32,023 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/347d2fcfafef447d87f6aa6e144f09ea for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,025 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5a928f483bd149d990b76ca7b06d09fb in 665ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:32,025 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5a928f483bd149d990b76ca7b06d09fb: 2023-02-13 15:03:32,025 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,025 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:32,025 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/c3c28e4e516f4f2a8e50403d022cc04f] hfiles 2023-02-13 15:03:32,025 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/c3c28e4e516f4f2a8e50403d022cc04f for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,026 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/0f28189932154d9b917d46096ca863ea] hfiles 2023-02-13 15:03:32,026 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/0f28189932154d9b917d46096ca863ea for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,043 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. completed. 2023-02-13 15:03:32,043 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:32,043 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 15:03:32,049 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. completed. 2023-02-13 15:03:32,049 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:32,049 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 15:03:32,144 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f1/975b284467424649955d494a0606c4cc 2023-02-13 15:03:32,165 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f2/8c00031e4bca4dcb8fb1d42024b4fb92 2023-02-13 15:03:32,172 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f1/975b284467424649955d494a0606c4cc as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/975b284467424649955d494a0606c4cc 2023-02-13 15:03:32,178 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/975b284467424649955d494a0606c4cc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:32,179 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f2/8c00031e4bca4dcb8fb1d42024b4fb92 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/8c00031e4bca4dcb8fb1d42024b4fb92 2023-02-13 15:03:32,186 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/8c00031e4bca4dcb8fb1d42024b4fb92, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:32,187 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f82b0422a13fa7e1368d4266d0ffa03f in 474ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:32,187 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f82b0422a13fa7e1368d4266d0ffa03f: 2023-02-13 15:03:32,187 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,187 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:32,187 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/975b284467424649955d494a0606c4cc] hfiles 2023-02-13 15:03:32,187 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/975b284467424649955d494a0606c4cc for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,187 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/8c00031e4bca4dcb8fb1d42024b4fb92] hfiles 2023-02-13 15:03:32,187 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/8c00031e4bca4dcb8fb1d42024b4fb92 for snapshot=testWithMapReduceMultiRegion 2023-02-13 15:03:32,194 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. completed. 2023-02-13 15:03:32,194 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:32,194 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 15:03:32,194 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 15:03:32,194 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,194 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 15:03:32,194 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,34169,1676300604777' in zk 2023-02-13 15:03:32,195 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,195 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 15:03:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:32,196 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:32,196 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 15:03:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:32,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:32,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:32,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,34169,1676300604777': 2023-02-13 15:03:32,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34169,1676300604777' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 15:03:32,199 INFO [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-13 15:03:32,199 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:32,199 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:32,199 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-13 15:03:32,199 INFO [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 15:03:32,217 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,217 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,217 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,217 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:32,217 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:32,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:32,218 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:32,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:32,218 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,220 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,220 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 15:03:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,229 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:32,229 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:32,230 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 15:03:32,230 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:32,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-13 15:03:32,230 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:32,229 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:32,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-13 15:03:32,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:32,230 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:32,230 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:32,230 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:32,231 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 15:03:32,231 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,231 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:32,231 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:32,231 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 15:03:32,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:32,231 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 15:03:32,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 15:03:32,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-13 15:03:32,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-13 15:03:32,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 15:03:32,330 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 15:03:32,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676300611239Consolidate snapshot: testWithMapReduceMultiRegion at 1676300612230 (+991 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676300612231 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676300612252 (+21 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676300612267 (+15 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676300612330 (+63 ms) 2023-02-13 15:03:32,332 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:03:32,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0920 sec 2023-02-13 15:03:32,369 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:32,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:32,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 15:03:32,371 INFO [Listener at localhost.localdomain/39751] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 15:03:32,384 INFO [Listener at localhost.localdomain/39751] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 15:03:32,397 INFO [Listener at localhost.localdomain/39751] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 15:03:32,459 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:32,471 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34169] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:32,674 INFO [Listener at localhost.localdomain/39751] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 15:03:32,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 15:03:32,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 15:03:32,695 INFO [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 15:03:32,695 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:32,695 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 15:03:32,695 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 15:03:32,696 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:32,696 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:32,697 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:32,697 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:32,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:32,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:32,697 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:32,698 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:32,698 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:32,698 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:32,698 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:32,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:32,699 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 15:03:32,699 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 15:03:32,701 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 15:03:32,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 15:03:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 15:03:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 15:03:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 15:03:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:32,704 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 15:03:32,704 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:32,705 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:32,705 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. started... 2023-02-13 15:03:32,705 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. started... 2023-02-13 15:03:32,705 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0757ff25434fd256d87f44bc8a24d25a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:32,705 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 189cc975fd2f2560d5d2ef65ad524252 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:32,711 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:32,711 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:32,712 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. started... 2023-02-13 15:03:32,712 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. started... 2023-02-13 15:03:32,712 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a0dd5d81ec4ea6ca6653c4055ae0a5ce 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 15:03:32,712 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9ac0d2a60686cec63e9906124fbe168b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 15:03:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:03:32,712 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 15:03:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:03:32,712 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:32,712 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. started... 2023-02-13 15:03:32,712 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. started... 2023-02-13 15:03:32,714 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 644cc8d2fca28f19448afd0116f7096e: 2023-02-13 15:03:32,714 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:32,714 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:32,714 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. started... 2023-02-13 15:03:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 15:03:32,715 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e3f636a3e94426a070b352ced6ac9e4d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:32,716 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5a928f483bd149d990b76ca7b06d09fb 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 15:03:32,784 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f1/3ab12d08ad3a4aaf90c82f200a821990 2023-02-13 15:03:32,791 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f1/9c48eebd65b04bbd882866e273566d98 2023-02-13 15:03:32,796 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f1/bd6ec1f0958a4aa98b73e613ca42c860 2023-02-13 15:03:32,798 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f1/84e6aeef6ef844cf9865b12b59715f59 2023-02-13 15:03:32,831 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f2/a4925420f0114ae3ac4486770ae14d53 2023-02-13 15:03:32,839 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f2/e2804b30327f4a489813e3d6259c73a8 2023-02-13 15:03:32,840 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f1/3ab12d08ad3a4aaf90c82f200a821990 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/3ab12d08ad3a4aaf90c82f200a821990 2023-02-13 15:03:32,843 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f2/0b25feeb51cf45e68f2f45fa6e7cb004 2023-02-13 15:03:32,843 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f2/21eaddb46f024cde9faea537d4171292 2023-02-13 15:03:32,849 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/3ab12d08ad3a4aaf90c82f200a821990, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,851 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f1/9c48eebd65b04bbd882866e273566d98 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/9c48eebd65b04bbd882866e273566d98 2023-02-13 15:03:32,851 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/.tmp/f2/a4925420f0114ae3ac4486770ae14d53 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/a4925420f0114ae3ac4486770ae14d53 2023-02-13 15:03:32,852 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f1/84e6aeef6ef844cf9865b12b59715f59 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/84e6aeef6ef844cf9865b12b59715f59 2023-02-13 15:03:32,852 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f1/bd6ec1f0958a4aa98b73e613ca42c860 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/bd6ec1f0958a4aa98b73e613ca42c860 2023-02-13 15:03:32,858 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/a4925420f0114ae3ac4486770ae14d53, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,858 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/84e6aeef6ef844cf9865b12b59715f59, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,859 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 189cc975fd2f2560d5d2ef65ad524252 in 154ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:32,859 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/.tmp/f2/0b25feeb51cf45e68f2f45fa6e7cb004 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/0b25feeb51cf45e68f2f45fa6e7cb004 2023-02-13 15:03:32,859 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 189cc975fd2f2560d5d2ef65ad524252: 2023-02-13 15:03:32,859 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/bd6ec1f0958a4aa98b73e613ca42c860, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:32,859 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:32,859 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:32,859 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 15:03:32,859 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. started... 2023-02-13 15:03:32,860 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f82b0422a13fa7e1368d4266d0ffa03f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:32,860 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/.tmp/f2/21eaddb46f024cde9faea537d4171292 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/21eaddb46f024cde9faea537d4171292 2023-02-13 15:03:32,863 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/9c48eebd65b04bbd882866e273566d98, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:32,865 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/.tmp/f2/e2804b30327f4a489813e3d6259c73a8 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/e2804b30327f4a489813e3d6259c73a8 2023-02-13 15:03:32,868 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/0b25feeb51cf45e68f2f45fa6e7cb004, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,869 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9ac0d2a60686cec63e9906124fbe168b in 157ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:32,869 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9ac0d2a60686cec63e9906124fbe168b: 2023-02-13 15:03:32,869 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:32,869 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:32,869 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 15:03:32,870 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. started... 2023-02-13 15:03:32,870 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7683b16f577bf67fd24f66bc0dc0597e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:32,873 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/e2804b30327f4a489813e3d6259c73a8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:32,873 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/21eaddb46f024cde9faea537d4171292, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:32,875 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5a928f483bd149d990b76ca7b06d09fb in 159ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:32,875 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for a0dd5d81ec4ea6ca6653c4055ae0a5ce in 162ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:32,875 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5a928f483bd149d990b76ca7b06d09fb: 2023-02-13 15:03:32,875 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: 2023-02-13 15:03:32,875 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:32,879 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:32,879 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 15:03:32,879 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 15:03:32,887 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f1/558cdb419573413bb4225eca6faa40b7 2023-02-13 15:03:32,903 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f1/e21873e3f4f541dea1ad933a850f5847 2023-02-13 15:03:32,925 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f2/cef79c90e67647e4a8412c4432355c58 2023-02-13 15:03:32,927 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f2/bd74f8b52f0e4afaba1a9d45f2bc89fe 2023-02-13 15:03:32,932 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f1/558cdb419573413bb4225eca6faa40b7 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/558cdb419573413bb4225eca6faa40b7 2023-02-13 15:03:32,935 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f1/e21873e3f4f541dea1ad933a850f5847 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/e21873e3f4f541dea1ad933a850f5847 2023-02-13 15:03:32,945 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/558cdb419573413bb4225eca6faa40b7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,945 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/e21873e3f4f541dea1ad933a850f5847, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,946 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/.tmp/f2/cef79c90e67647e4a8412c4432355c58 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/cef79c90e67647e4a8412c4432355c58 2023-02-13 15:03:32,946 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/.tmp/f2/bd74f8b52f0e4afaba1a9d45f2bc89fe as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/bd74f8b52f0e4afaba1a9d45f2bc89fe 2023-02-13 15:03:32,953 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/bd74f8b52f0e4afaba1a9d45f2bc89fe, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,954 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7683b16f577bf67fd24f66bc0dc0597e in 84ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:32,955 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7683b16f577bf67fd24f66bc0dc0597e: 2023-02-13 15:03:32,955 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:32,955 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:32,955 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 15:03:32,955 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. started... 2023-02-13 15:03:32,955 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9d8058518fb19b4163360de6733e9693: 2023-02-13 15:03:32,955 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:32,955 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 15:03:32,957 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/cef79c90e67647e4a8412c4432355c58, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:32,958 INFO [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f82b0422a13fa7e1368d4266d0ffa03f in 99ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:32,958 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f82b0422a13fa7e1368d4266d0ffa03f: 2023-02-13 15:03:32,958 DEBUG [rs(jenkins-hbase20.apache.org,34169,1676300604777)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:32,958 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 15:03:32,958 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 15:03:32,958 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,958 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 15:03:32,958 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34169,1676300604777' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 15:03:32,960 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:32,960 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:32,961 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:32,961 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:32,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34169,1676300604777' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 15:03:32,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@612486ac[Count = 1] remaining members to acquire global barrier 2023-02-13 15:03:33,062 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 15:03:33,132 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 15:03:33,133 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 15:03:33,193 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f1/065a82b968e742dfbde73ef9a2defcd2 2023-02-13 15:03:33,195 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f1/f51cc099d85742e3878544f8913f366d 2023-02-13 15:03:33,213 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f2/acee633ac2f44aba9c858aebae167ef8 2023-02-13 15:03:33,223 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f1/065a82b968e742dfbde73ef9a2defcd2 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/065a82b968e742dfbde73ef9a2defcd2 2023-02-13 15:03:33,223 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f2/db7c0902c1ef40d4b5e2c665506b6802 2023-02-13 15:03:33,231 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f1/f51cc099d85742e3878544f8913f366d as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/f51cc099d85742e3878544f8913f366d 2023-02-13 15:03:33,234 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/065a82b968e742dfbde73ef9a2defcd2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:33,235 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/.tmp/f2/acee633ac2f44aba9c858aebae167ef8 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/acee633ac2f44aba9c858aebae167ef8 2023-02-13 15:03:33,239 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/f51cc099d85742e3878544f8913f366d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:33,241 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/.tmp/f2/db7c0902c1ef40d4b5e2c665506b6802 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/db7c0902c1ef40d4b5e2c665506b6802 2023-02-13 15:03:33,248 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/acee633ac2f44aba9c858aebae167ef8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:33,250 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0757ff25434fd256d87f44bc8a24d25a in 544ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:33,250 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0757ff25434fd256d87f44bc8a24d25a: 2023-02-13 15:03:33,250 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:33,250 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 15:03:33,257 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/db7c0902c1ef40d4b5e2c665506b6802, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:33,258 INFO [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e3f636a3e94426a070b352ced6ac9e4d in 544ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:33,258 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e3f636a3e94426a070b352ced6ac9e4d: 2023-02-13 15:03:33,258 DEBUG [rs(jenkins-hbase20.apache.org,32817,1676300604733)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 15:03:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 15:03:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 15:03:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32817,1676300604733' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 15:03:33,260 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,260 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:33,260 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,261 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:33,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32817,1676300604733' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 15:03:33,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@612486ac[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:33,262 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 15:03:33,262 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,264 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,264 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,265 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 15:03:33,265 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 15:03:33,265 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,265 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 15:03:33,265 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,32817,1676300604733' in zk 2023-02-13 15:03:33,265 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 15:03:33,266 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,34169,1676300604777' in zk 2023-02-13 15:03:33,275 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 15:03:33,276 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,276 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:33,276 DEBUG [member: 'jenkins-hbase20.apache.org,32817,1676300604733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 15:03:33,283 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,283 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 15:03:33,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:33,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:33,283 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32817,1676300604733' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 15:03:33,283 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:33,283 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:33,284 DEBUG [member: 'jenkins-hbase20.apache.org,34169,1676300604777' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 15:03:33,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:33,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:33,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,34169,1676300604777': 2023-02-13 15:03:33,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34169,1676300604777' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 15:03:33,287 INFO [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 15:03:33,287 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:33,287 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:33,287 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 15:03:33,287 INFO [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 15:03:33,291 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,291 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,291 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:33,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,291 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:33,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,291 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:33,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:33,292 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:33,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:33,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,292 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:33,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,294 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:33,294 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:33,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,302 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,302 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:33,302 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:33,302 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:33,302 DEBUG [(jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:33,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:33,302 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 15:03:33,303 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 15:03:33,302 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:33,302 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:33,302 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:33,303 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:33,303 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:33,303 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,303 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:33,304 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:33,304 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:33,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:33,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:33,305 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:33,305 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 15:03:33,405 DEBUG [Listener at localhost.localdomain/39751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 15:03:33,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 15:03:33,507 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop-971824235818962890.jar 2023-02-13 15:03:33,525 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676300611200 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:33,526 DEBUG [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce 2023-02-13 15:03:33,527 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:33,527 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:33,527 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:33,527 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:33,527 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:33,527 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:33,527 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(239): region to add: f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=189cc975fd2f2560d5d2ef65ad524252 as 189cc975fd2f2560d5d2ef65ad524252 in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=0757ff25434fd256d87f44bc8a24d25a as 0757ff25434fd256d87f44bc8a24d25a in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=a0dd5d81ec4ea6ca6653c4055ae0a5ce as a0dd5d81ec4ea6ca6653c4055ae0a5ce in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=9ac0d2a60686cec63e9906124fbe168b as 9ac0d2a60686cec63e9906124fbe168b in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,528 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=e3f636a3e94426a070b352ced6ac9e4d as e3f636a3e94426a070b352ced6ac9e4d in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,529 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=644cc8d2fca28f19448afd0116f7096e as 644cc8d2fca28f19448afd0116f7096e in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,529 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=7683b16f577bf67fd24f66bc0dc0597e as 7683b16f577bf67fd24f66bc0dc0597e in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,529 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=5a928f483bd149d990b76ca7b06d09fb as 5a928f483bd149d990b76ca7b06d09fb in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,529 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=9d8058518fb19b4163360de6733e9693 as 9d8058518fb19b4163360de6733e9693 in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,529 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(585): clone region=f82b0422a13fa7e1368d4266d0ffa03f as f82b0422a13fa7e1368d4266d0ffa03f in snapshot testWithMapReduceMultiRegion 2023-02-13 15:03:33,532 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 644cc8d2fca28f19448afd0116f7096e, NAME => 'testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,532 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9ac0d2a60686cec63e9906124fbe168b, NAME => 'testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,532 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a0dd5d81ec4ea6ca6653c4055ae0a5ce, NAME => 'testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,533 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0757ff25434fd256d87f44bc8a24d25a, NAME => 'testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,533 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => e3f636a3e94426a070b352ced6ac9e4d, NAME => 'testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,533 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 5a928f483bd149d990b76ca7b06d09fb, NAME => 'testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,533 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 189cc975fd2f2560d5d2ef65ad524252, NAME => 'testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,533 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 7683b16f577bf67fd24f66bc0dc0597e, NAME => 'testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,560 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,560 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5cadc0d064984ee9878314a89540210d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,563 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,563 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,563 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 644cc8d2fca28f19448afd0116f7096e, disabling compactions & flushes 2023-02-13 15:03:33,563 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:33,563 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:33,563 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. after waiting 0 ms 2023-02-13 15:03:33,563 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:33,563 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 21421429f4814699badd4498745e5c12 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,563 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:33,563 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 644cc8d2fca28f19448afd0116f7096e: Waiting for close lock at 1676300613563Disabling compacts and flushes for region at 1676300613563Disabling writes for close at 1676300613563Writing region close event to WAL at 1676300613563Closed at 1676300613563 2023-02-13 15:03:33,564 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 9d8058518fb19b4163360de6733e9693, NAME => 'testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,568 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,568 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,568 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a88eb4542d1c468992d74a700243881d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,568 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a3d8f512a24942ea880404331a39e0ff from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,569 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,569 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6c74514479fa4d0284eae2b53e1ae4c1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,569 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1af4bf7eeb5a4f359b82cc8c228b826f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,570 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,570 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c3c28e4e516f4f2a8e50403d022cc04f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,571 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d4fcb8320960405893d17c87933ac9c4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,590 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bd5400237aba485ebaba4d3dce97e552 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,592 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a7e2ebd9e117467199cd40185420df58 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,592 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 347d2fcfafef447d87f6aa6e144f09ea from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,593 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0f28189932154d9b917d46096ca863ea from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 189cc975fd2f2560d5d2ef65ad524252, disabling compactions & flushes 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 7683b16f577bf67fd24f66bc0dc0597e, disabling compactions & flushes 2023-02-13 15:03:33,593 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:33,593 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. after waiting 0 ms 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. after waiting 0 ms 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 9d8058518fb19b4163360de6733e9693, disabling compactions & flushes 2023-02-13 15:03:33,593 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:33,593 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:33,594 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 7683b16f577bf67fd24f66bc0dc0597e: Waiting for close lock at 1676300613593Disabling compacts and flushes for region at 1676300613593Disabling writes for close at 1676300613593Writing region close event to WAL at 1676300613593Closed at 1676300613593 2023-02-13 15:03:33,594 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => f82b0422a13fa7e1368d4266d0ffa03f, NAME => 'testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,593 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:33,593 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:33,595 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 189cc975fd2f2560d5d2ef65ad524252: Waiting for close lock at 1676300613593Disabling compacts and flushes for region at 1676300613593Disabling writes for close at 1676300613593Writing region close event to WAL at 1676300613593Closed at 1676300613593 2023-02-13 15:03:33,595 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:33,595 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. after waiting 0 ms 2023-02-13 15:03:33,595 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:33,595 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:33,596 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 9d8058518fb19b4163360de6733e9693: Waiting for close lock at 1676300613593Disabling compacts and flushes for region at 1676300613593Disabling writes for close at 1676300613595 (+2 ms)Writing region close event to WAL at 1676300613595Closed at 1676300613595 2023-02-13 15:03:33,599 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 0757ff25434fd256d87f44bc8a24d25a, disabling compactions & flushes 2023-02-13 15:03:33,599 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:33,599 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:33,599 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9ac0d2a60686cec63e9906124fbe168b, disabling compactions & flushes 2023-02-13 15:03:33,600 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. after waiting 0 ms 2023-02-13 15:03:33,600 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:33,600 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:33,600 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. after waiting 0 ms 2023-02-13 15:03:33,600 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:33,600 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:33,600 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:33,600 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:33,600 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9ac0d2a60686cec63e9906124fbe168b: Waiting for close lock at 1676300613599Disabling compacts and flushes for region at 1676300613599Disabling writes for close at 1676300613600 (+1 ms)Writing region close event to WAL at 1676300613600Closed at 1676300613600 2023-02-13 15:03:33,600 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 0757ff25434fd256d87f44bc8a24d25a: Waiting for close lock at 1676300613599Disabling compacts and flushes for region at 1676300613599Disabling writes for close at 1676300613600 (+1 ms)Writing region close event to WAL at 1676300613600Closed at 1676300613600 2023-02-13 15:03:33,603 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a0dd5d81ec4ea6ca6653c4055ae0a5ce, disabling compactions & flushes 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 5a928f483bd149d990b76ca7b06d09fb, disabling compactions & flushes 2023-02-13 15:03:33,604 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:33,604 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. after waiting 0 ms 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. after waiting 0 ms 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:33,604 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:33,604 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: Waiting for close lock at 1676300613603Disabling compacts and flushes for region at 1676300613603Disabling writes for close at 1676300613604 (+1 ms)Writing region close event to WAL at 1676300613604Closed at 1676300613604 2023-02-13 15:03:33,604 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 5a928f483bd149d990b76ca7b06d09fb: Waiting for close lock at 1676300613604Disabling compacts and flushes for region at 1676300613604Disabling writes for close at 1676300613604Writing region close event to WAL at 1676300613604Closed at 1676300613604 2023-02-13 15:03:33,608 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,608 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 975b284467424649955d494a0606c4cc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,610 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c00031e4bca4dcb8fb1d42024b4fb92 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,612 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing f82b0422a13fa7e1368d4266d0ffa03f, disabling compactions & flushes 2023-02-13 15:03:33,612 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:33,612 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:33,612 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. after waiting 0 ms 2023-02-13 15:03:33,612 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:33,612 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:33,612 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for f82b0422a13fa7e1368d4266d0ffa03f: Waiting for close lock at 1676300613612Disabling compacts and flushes for region at 1676300613612Disabling writes for close at 1676300613612Writing region close event to WAL at 1676300613612Closed at 1676300613612 2023-02-13 15:03:33,864 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:03:33,865 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 15:03:33,968 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:33,968 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 973ff68cf6804868b6cb5fd23fbbec23 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,970 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 61ef4413d599404da977550f351ae332 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 15:03:33,974 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing e3f636a3e94426a070b352ced6ac9e4d, disabling compactions & flushes 2023-02-13 15:03:33,974 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:33,974 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:33,975 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. after waiting 0 ms 2023-02-13 15:03:33,975 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:33,975 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:33,975 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for e3f636a3e94426a070b352ced6ac9e4d: Waiting for close lock at 1676300613974Disabling compacts and flushes for region at 1676300613974Disabling writes for close at 1676300613975 (+1 ms)Writing region close event to WAL at 1676300613975Closed at 1676300613975 2023-02-13 15:03:33,975 INFO [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676300611200 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:33,975 DEBUG [Listener at localhost.localdomain/39751] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,975 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc 2023-02-13 15:03:33,976 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-data/ 2023-02-13 15:03:33,976 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----default/ 2023-02-13 15:03:33,977 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 15:03:33,977 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------0757ff25434fd256d87f44bc8a24d25a/ 2023-02-13 15:03:33,978 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,978 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,978 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=0757ff25434fd256d87f44bc8a24d25a-1af4bf7eeb5a4f359b82cc8c228b826f 2023-02-13 15:03:33,978 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,979 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=0757ff25434fd256d87f44bc8a24d25a-a7e2ebd9e117467199cd40185420df58 2023-02-13 15:03:33,979 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------189cc975fd2f2560d5d2ef65ad524252/ 2023-02-13 15:03:33,979 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,979 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,980 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=189cc975fd2f2560d5d2ef65ad524252-21421429f4814699badd4498745e5c12 2023-02-13 15:03:33,980 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,980 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=189cc975fd2f2560d5d2ef65ad524252-d4fcb8320960405893d17c87933ac9c4 2023-02-13 15:03:33,980 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------5a928f483bd149d990b76ca7b06d09fb/ 2023-02-13 15:03:33,981 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,981 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,981 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=5a928f483bd149d990b76ca7b06d09fb-c3c28e4e516f4f2a8e50403d022cc04f 2023-02-13 15:03:33,982 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,982 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=5a928f483bd149d990b76ca7b06d09fb-0f28189932154d9b917d46096ca863ea 2023-02-13 15:03:33,982 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------644cc8d2fca28f19448afd0116f7096e/ 2023-02-13 15:03:33,983 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,983 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------7683b16f577bf67fd24f66bc0dc0597e/ 2023-02-13 15:03:33,983 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,983 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,984 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=7683b16f577bf67fd24f66bc0dc0597e-5cadc0d064984ee9878314a89540210d 2023-02-13 15:03:33,984 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,984 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=7683b16f577bf67fd24f66bc0dc0597e-6c74514479fa4d0284eae2b53e1ae4c1 2023-02-13 15:03:33,984 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------9ac0d2a60686cec63e9906124fbe168b/ 2023-02-13 15:03:33,985 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,985 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,985 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=9ac0d2a60686cec63e9906124fbe168b-a3d8f512a24942ea880404331a39e0ff 2023-02-13 15:03:33,985 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,986 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=9ac0d2a60686cec63e9906124fbe168b-bd5400237aba485ebaba4d3dce97e552 2023-02-13 15:03:33,986 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------9d8058518fb19b4163360de6733e9693/ 2023-02-13 15:03:33,986 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,986 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------a0dd5d81ec4ea6ca6653c4055ae0a5ce/ 2023-02-13 15:03:33,986 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,987 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,987 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=a0dd5d81ec4ea6ca6653c4055ae0a5ce-a88eb4542d1c468992d74a700243881d 2023-02-13 15:03:33,987 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,988 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=a0dd5d81ec4ea6ca6653c4055ae0a5ce-347d2fcfafef447d87f6aa6e144f09ea 2023-02-13 15:03:33,988 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------e3f636a3e94426a070b352ced6ac9e4d/ 2023-02-13 15:03:33,988 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,988 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,989 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=e3f636a3e94426a070b352ced6ac9e4d-973ff68cf6804868b6cb5fd23fbbec23 2023-02-13 15:03:33,989 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,990 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=e3f636a3e94426a070b352ced6ac9e4d-61ef4413d599404da977550f351ae332 2023-02-13 15:03:33,990 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |----------f82b0422a13fa7e1368d4266d0ffa03f/ 2023-02-13 15:03:33,991 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:33,991 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:33,991 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=f82b0422a13fa7e1368d4266d0ffa03f-975b284467424649955d494a0606c4cc 2023-02-13 15:03:33,991 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:33,992 DEBUG [Listener at localhost.localdomain/39751] util.CommonFSUtils(702): |----------------testWithMapReduce=f82b0422a13fa7e1368d4266d0ffa03f-8c00031e4bca4dcb8fb1d42024b4fb92 2023-02-13 15:03:34,000 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,001 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,001 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,002 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,002 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,002 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,003 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,066 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop-8526618163130673039.jar 2023-02-13 15:03:34,067 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,067 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,067 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,068 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,069 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,069 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,070 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 15:03:34,070 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 15:03:34,071 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 15:03:34,072 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 15:03:34,072 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 15:03:34,073 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 15:03:34,073 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 15:03:34,073 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 15:03:34,074 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 15:03:34,075 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 15:03:34,080 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:34,080 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:03:34,080 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:03:34,081 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:03:34,081 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 15:03:34,153 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop-2613389666003724192.jar 2023-02-13 15:03:34,154 DEBUG [Listener at localhost.localdomain/39751] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 15:03:34,209 WARN [Listener at localhost.localdomain/39751] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 15:03:34,270 INFO [Listener at localhost.localdomain/39751] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 15:03:34,768 WARN [Listener at localhost.localdomain/39751] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/mapreduce.cluster.local.dir/1676300614633/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 15:03:34,768 WARN [Listener at localhost.localdomain/39751] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/mapreduce.cluster.local.dir/1676300614633/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 15:03:34,935 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:34,935 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:34,937 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:34,939 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:34,941 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1 2023-02-13 15:03:34,941 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7683b16f577bf67fd24f66bc0dc0597e columnFamilyName f1 2023-02-13 15:03:34,950 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/testWithMapReduce=7683b16f577bf67fd24f66bc0dc0597e-5cadc0d064984ee9878314a89540210d 2023-02-13 15:03:34,951 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(310): Store=7683b16f577bf67fd24f66bc0dc0597e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:34,951 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:34,952 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2 2023-02-13 15:03:34,952 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7683b16f577bf67fd24f66bc0dc0597e columnFamilyName f2 2023-02-13 15:03:34,958 DEBUG [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/testWithMapReduce=7683b16f577bf67fd24f66bc0dc0597e-6c74514479fa4d0284eae2b53e1ae4c1 2023-02-13 15:03:34,958 INFO [StoreOpener-7683b16f577bf67fd24f66bc0dc0597e-1] regionserver.HStore(310): Store=7683b16f577bf67fd24f66bc0dc0597e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:34,958 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:34,958 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7683b16f577bf67fd24f66bc0dc0597e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69629264, jitterRate=0.03755688667297363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:34,958 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7683b16f577bf67fd24f66bc0dc0597e: Writing region info on filesystem at 1676300614937Initializing all the Stores at 1676300614938 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300614938Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300614938Region opened successfully at 1676300614958 (+20 ms) 2023-02-13 15:03:35,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7683b16f577bf67fd24f66bc0dc0597e, disabling compactions & flushes 2023-02-13 15:03:35,104 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:35,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:35,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. after waiting 0 ms 2023-02-13 15:03:35,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:35,113 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:35,113 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7683b16f577bf67fd24f66bc0dc0597e: Waiting for close lock at 1676300615104Disabling compacts and flushes for region at 1676300615104Disabling writes for close at 1676300615104Writing region close event to WAL at 1676300615113 (+9 ms)Closed at 1676300615113 2023-02-13 15:03:35,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,129 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,136 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,138 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:35,140 DEBUG [StoreOpener-9d8058518fb19b4163360de6733e9693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f1 2023-02-13 15:03:35,140 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d8058518fb19b4163360de6733e9693 columnFamilyName f1 2023-02-13 15:03:35,141 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(310): Store=9d8058518fb19b4163360de6733e9693/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,141 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:35,142 DEBUG [StoreOpener-9d8058518fb19b4163360de6733e9693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f2 2023-02-13 15:03:35,143 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d8058518fb19b4163360de6733e9693 columnFamilyName f2 2023-02-13 15:03:35,143 INFO [StoreOpener-9d8058518fb19b4163360de6733e9693-1] regionserver.HStore(310): Store=9d8058518fb19b4163360de6733e9693/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,144 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9d8058518fb19b4163360de6733e9693; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73435021, jitterRate=0.09426708519458771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9d8058518fb19b4163360de6733e9693: Writing region info on filesystem at 1676300615136Initializing all the Stores at 1676300615137 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615137Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615137Region opened successfully at 1676300615144 (+7 ms) 2023-02-13 15:03:35,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9d8058518fb19b4163360de6733e9693, disabling compactions & flushes 2023-02-13 15:03:35,157 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:35,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:35,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. after waiting 0 ms 2023-02-13 15:03:35,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:35,157 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:35,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9d8058518fb19b4163360de6733e9693: Waiting for close lock at 1676300615157Disabling compacts and flushes for region at 1676300615157Disabling writes for close at 1676300615157Writing region close event to WAL at 1676300615157Closed at 1676300615157 2023-02-13 15:03:35,164 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,164 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,167 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,169 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:35,170 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1 2023-02-13 15:03:35,171 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0757ff25434fd256d87f44bc8a24d25a columnFamilyName f1 2023-02-13 15:03:35,180 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/testWithMapReduce=0757ff25434fd256d87f44bc8a24d25a-1af4bf7eeb5a4f359b82cc8c228b826f 2023-02-13 15:03:35,180 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(310): Store=0757ff25434fd256d87f44bc8a24d25a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,180 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:35,182 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2 2023-02-13 15:03:35,182 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0757ff25434fd256d87f44bc8a24d25a columnFamilyName f2 2023-02-13 15:03:35,189 DEBUG [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/testWithMapReduce=0757ff25434fd256d87f44bc8a24d25a-a7e2ebd9e117467199cd40185420df58 2023-02-13 15:03:35,190 INFO [StoreOpener-0757ff25434fd256d87f44bc8a24d25a-1] regionserver.HStore(310): Store=0757ff25434fd256d87f44bc8a24d25a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,190 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0757ff25434fd256d87f44bc8a24d25a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67999432, jitterRate=0.01327049732208252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0757ff25434fd256d87f44bc8a24d25a: Writing region info on filesystem at 1676300615167Initializing all the Stores at 1676300615168 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615168Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615169 (+1 ms)Region opened successfully at 1676300615190 (+21 ms) 2023-02-13 15:03:35,245 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0757ff25434fd256d87f44bc8a24d25a, disabling compactions & flushes 2023-02-13 15:03:35,245 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:35,245 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:35,245 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. after waiting 0 ms 2023-02-13 15:03:35,245 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:35,248 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:35,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0757ff25434fd256d87f44bc8a24d25a: Waiting for close lock at 1676300615244Disabling compacts and flushes for region at 1676300615244Disabling writes for close at 1676300615245 (+1 ms)Writing region close event to WAL at 1676300615248 (+3 ms)Closed at 1676300615248 2023-02-13 15:03:35,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,254 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,255 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,263 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:35,265 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1 2023-02-13 15:03:35,266 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0dd5d81ec4ea6ca6653c4055ae0a5ce columnFamilyName f1 2023-02-13 15:03:35,279 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/testWithMapReduce=a0dd5d81ec4ea6ca6653c4055ae0a5ce-a88eb4542d1c468992d74a700243881d 2023-02-13 15:03:35,280 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(310): Store=a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,280 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:35,281 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2 2023-02-13 15:03:35,282 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0dd5d81ec4ea6ca6653c4055ae0a5ce columnFamilyName f2 2023-02-13 15:03:35,295 DEBUG [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/testWithMapReduce=a0dd5d81ec4ea6ca6653c4055ae0a5ce-347d2fcfafef447d87f6aa6e144f09ea 2023-02-13 15:03:35,295 INFO [StoreOpener-a0dd5d81ec4ea6ca6653c4055ae0a5ce-1] regionserver.HStore(310): Store=a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,296 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a0dd5d81ec4ea6ca6653c4055ae0a5ce; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74490851, jitterRate=0.11000017821788788}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: Writing region info on filesystem at 1676300615255Initializing all the Stores at 1676300615256 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615256Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615262 (+6 ms)Region opened successfully at 1676300615296 (+34 ms) 2023-02-13 15:03:35,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a0dd5d81ec4ea6ca6653c4055ae0a5ce, disabling compactions & flushes 2023-02-13 15:03:35,375 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:35,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:35,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. after waiting 0 ms 2023-02-13 15:03:35,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:35,379 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:35,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: Waiting for close lock at 1676300615375Disabling compacts and flushes for region at 1676300615375Disabling writes for close at 1676300615375Writing region close event to WAL at 1676300615379 (+4 ms)Closed at 1676300615379 2023-02-13 15:03:35,384 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,384 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,385 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,387 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:35,388 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1 2023-02-13 15:03:35,389 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 189cc975fd2f2560d5d2ef65ad524252 columnFamilyName f1 2023-02-13 15:03:35,399 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/testWithMapReduce=189cc975fd2f2560d5d2ef65ad524252-21421429f4814699badd4498745e5c12 2023-02-13 15:03:35,400 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(310): Store=189cc975fd2f2560d5d2ef65ad524252/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,400 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:35,401 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2 2023-02-13 15:03:35,401 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 189cc975fd2f2560d5d2ef65ad524252 columnFamilyName f2 2023-02-13 15:03:35,421 DEBUG [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/testWithMapReduce=189cc975fd2f2560d5d2ef65ad524252-d4fcb8320960405893d17c87933ac9c4 2023-02-13 15:03:35,422 INFO [StoreOpener-189cc975fd2f2560d5d2ef65ad524252-1] regionserver.HStore(310): Store=189cc975fd2f2560d5d2ef65ad524252/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,422 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,422 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 189cc975fd2f2560d5d2ef65ad524252; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67803407, jitterRate=0.010349497199058533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,422 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 189cc975fd2f2560d5d2ef65ad524252: Writing region info on filesystem at 1676300615385Initializing all the Stores at 1676300615386 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615386Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615386Region opened successfully at 1676300615422 (+36 ms) 2023-02-13 15:03:35,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 189cc975fd2f2560d5d2ef65ad524252, disabling compactions & flushes 2023-02-13 15:03:35,454 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:35,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:35,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. after waiting 0 ms 2023-02-13 15:03:35,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:35,456 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:35,456 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 189cc975fd2f2560d5d2ef65ad524252: Waiting for close lock at 1676300615453Disabling compacts and flushes for region at 1676300615453Disabling writes for close at 1676300615454 (+1 ms)Writing region close event to WAL at 1676300615456 (+2 ms)Closed at 1676300615456 2023-02-13 15:03:35,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,464 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,471 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,473 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:35,474 DEBUG [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f1 2023-02-13 15:03:35,475 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 644cc8d2fca28f19448afd0116f7096e columnFamilyName f1 2023-02-13 15:03:35,476 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(310): Store=644cc8d2fca28f19448afd0116f7096e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,476 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:35,478 DEBUG [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f2 2023-02-13 15:03:35,478 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 644cc8d2fca28f19448afd0116f7096e columnFamilyName f2 2023-02-13 15:03:35,479 INFO [StoreOpener-644cc8d2fca28f19448afd0116f7096e-1] regionserver.HStore(310): Store=644cc8d2fca28f19448afd0116f7096e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,479 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,479 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 644cc8d2fca28f19448afd0116f7096e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70812965, jitterRate=0.0551954060792923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,480 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 644cc8d2fca28f19448afd0116f7096e: Writing region info on filesystem at 1676300615471Initializing all the Stores at 1676300615472 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615472Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615472Region opened successfully at 1676300615480 (+8 ms) 2023-02-13 15:03:35,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 644cc8d2fca28f19448afd0116f7096e, disabling compactions & flushes 2023-02-13 15:03:35,488 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:35,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:35,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. after waiting 0 ms 2023-02-13 15:03:35,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:35,488 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:35,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 644cc8d2fca28f19448afd0116f7096e: Waiting for close lock at 1676300615488Disabling compacts and flushes for region at 1676300615488Disabling writes for close at 1676300615488Writing region close event to WAL at 1676300615488Closed at 1676300615488 2023-02-13 15:03:35,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,493 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,502 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,505 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:35,506 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1 2023-02-13 15:03:35,507 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a928f483bd149d990b76ca7b06d09fb columnFamilyName f1 2023-02-13 15:03:35,515 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/testWithMapReduce=5a928f483bd149d990b76ca7b06d09fb-c3c28e4e516f4f2a8e50403d022cc04f 2023-02-13 15:03:35,515 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(310): Store=5a928f483bd149d990b76ca7b06d09fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,515 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:35,516 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2 2023-02-13 15:03:35,517 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a928f483bd149d990b76ca7b06d09fb columnFamilyName f2 2023-02-13 15:03:35,525 DEBUG [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/testWithMapReduce=5a928f483bd149d990b76ca7b06d09fb-0f28189932154d9b917d46096ca863ea 2023-02-13 15:03:35,525 INFO [StoreOpener-5a928f483bd149d990b76ca7b06d09fb-1] regionserver.HStore(310): Store=5a928f483bd149d990b76ca7b06d09fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,526 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5a928f483bd149d990b76ca7b06d09fb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72349321, jitterRate=0.07808889448642731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5a928f483bd149d990b76ca7b06d09fb: Writing region info on filesystem at 1676300615502Initializing all the Stores at 1676300615504 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615504Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615504Region opened successfully at 1676300615526 (+22 ms) 2023-02-13 15:03:35,557 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5a928f483bd149d990b76ca7b06d09fb, disabling compactions & flushes 2023-02-13 15:03:35,558 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:35,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:35,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. after waiting 0 ms 2023-02-13 15:03:35,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:35,562 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:35,562 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5a928f483bd149d990b76ca7b06d09fb: Waiting for close lock at 1676300615557Disabling compacts and flushes for region at 1676300615557Disabling writes for close at 1676300615558 (+1 ms)Writing region close event to WAL at 1676300615562 (+4 ms)Closed at 1676300615562 2023-02-13 15:03:35,570 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,570 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,573 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,575 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:35,576 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1 2023-02-13 15:03:35,577 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ac0d2a60686cec63e9906124fbe168b columnFamilyName f1 2023-02-13 15:03:35,584 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/testWithMapReduce=9ac0d2a60686cec63e9906124fbe168b-a3d8f512a24942ea880404331a39e0ff 2023-02-13 15:03:35,584 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(310): Store=9ac0d2a60686cec63e9906124fbe168b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,584 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:35,585 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2 2023-02-13 15:03:35,586 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ac0d2a60686cec63e9906124fbe168b columnFamilyName f2 2023-02-13 15:03:35,591 DEBUG [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/testWithMapReduce=9ac0d2a60686cec63e9906124fbe168b-bd5400237aba485ebaba4d3dce97e552 2023-02-13 15:03:35,591 INFO [StoreOpener-9ac0d2a60686cec63e9906124fbe168b-1] regionserver.HStore(310): Store=9ac0d2a60686cec63e9906124fbe168b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,592 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9ac0d2a60686cec63e9906124fbe168b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61549603, jitterRate=-0.08283944427967072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9ac0d2a60686cec63e9906124fbe168b: Writing region info on filesystem at 1676300615573Initializing all the Stores at 1676300615574 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615574Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615574Region opened successfully at 1676300615592 (+18 ms) 2023-02-13 15:03:35,614 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9ac0d2a60686cec63e9906124fbe168b, disabling compactions & flushes 2023-02-13 15:03:35,615 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:35,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:35,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. after waiting 0 ms 2023-02-13 15:03:35,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:35,617 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:35,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9ac0d2a60686cec63e9906124fbe168b: Waiting for close lock at 1676300615614Disabling compacts and flushes for region at 1676300615614Disabling writes for close at 1676300615615 (+1 ms)Writing region close event to WAL at 1676300615617 (+2 ms)Closed at 1676300615617 2023-02-13 15:03:35,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,623 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,625 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,627 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:35,628 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1 2023-02-13 15:03:35,629 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f82b0422a13fa7e1368d4266d0ffa03f columnFamilyName f1 2023-02-13 15:03:35,634 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/testWithMapReduce=f82b0422a13fa7e1368d4266d0ffa03f-975b284467424649955d494a0606c4cc 2023-02-13 15:03:35,635 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(310): Store=f82b0422a13fa7e1368d4266d0ffa03f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,635 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:35,636 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2 2023-02-13 15:03:35,636 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f82b0422a13fa7e1368d4266d0ffa03f columnFamilyName f2 2023-02-13 15:03:35,642 DEBUG [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/testWithMapReduce=f82b0422a13fa7e1368d4266d0ffa03f-8c00031e4bca4dcb8fb1d42024b4fb92 2023-02-13 15:03:35,642 INFO [StoreOpener-f82b0422a13fa7e1368d4266d0ffa03f-1] regionserver.HStore(310): Store=f82b0422a13fa7e1368d4266d0ffa03f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,642 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f82b0422a13fa7e1368d4266d0ffa03f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66866005, jitterRate=-0.003618881106376648}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f82b0422a13fa7e1368d4266d0ffa03f: Writing region info on filesystem at 1676300615625Initializing all the Stores at 1676300615626 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615626Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615626Region opened successfully at 1676300615642 (+16 ms) 2023-02-13 15:03:35,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f82b0422a13fa7e1368d4266d0ffa03f, disabling compactions & flushes 2023-02-13 15:03:35,676 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:35,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:35,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. after waiting 0 ms 2023-02-13 15:03:35,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:35,678 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:35,679 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f82b0422a13fa7e1368d4266d0ffa03f: Waiting for close lock at 1676300615676Disabling compacts and flushes for region at 1676300615676Disabling writes for close at 1676300615676Writing region close event to WAL at 1676300615678 (+2 ms)Closed at 1676300615678 2023-02-13 15:03:35,683 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:35,683 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:35,684 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:35,686 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:35,687 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1 2023-02-13 15:03:35,688 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3f636a3e94426a070b352ced6ac9e4d columnFamilyName f1 2023-02-13 15:03:35,694 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/testWithMapReduce=e3f636a3e94426a070b352ced6ac9e4d-973ff68cf6804868b6cb5fd23fbbec23 2023-02-13 15:03:35,694 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(310): Store=e3f636a3e94426a070b352ced6ac9e4d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,694 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:35,695 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2 2023-02-13 15:03:35,696 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3f636a3e94426a070b352ced6ac9e4d columnFamilyName f2 2023-02-13 15:03:35,701 DEBUG [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40743/user/jenkins/test-data/0547a8b0-e8ed-e9f8-04d8-6c5804cebe40/testWithMapReduceMultiRegion/0f1236fd-fddc-4f78-8c94-d460dd3ee5cc/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/testWithMapReduce=e3f636a3e94426a070b352ced6ac9e4d-61ef4413d599404da977550f351ae332 2023-02-13 15:03:35,702 INFO [StoreOpener-e3f636a3e94426a070b352ced6ac9e4d-1] regionserver.HStore(310): Store=e3f636a3e94426a070b352ced6ac9e4d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:35,702 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:35,702 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e3f636a3e94426a070b352ced6ac9e4d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63247186, jitterRate=-0.05754348635673523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:35,702 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e3f636a3e94426a070b352ced6ac9e4d: Writing region info on filesystem at 1676300615684Initializing all the Stores at 1676300615685 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615685Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300615685Region opened successfully at 1676300615702 (+17 ms) 2023-02-13 15:03:35,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e3f636a3e94426a070b352ced6ac9e4d, disabling compactions & flushes 2023-02-13 15:03:35,719 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:35,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:35,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. after waiting 0 ms 2023-02-13 15:03:35,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:35,722 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:35,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e3f636a3e94426a070b352ced6ac9e4d: Waiting for close lock at 1676300615719Disabling compacts and flushes for region at 1676300615719Disabling writes for close at 1676300615720 (+1 ms)Writing region close event to WAL at 1676300615722 (+2 ms)Closed at 1676300615722 2023-02-13 15:03:36,879 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceMultiRegion" 2023-02-13 15:03:36,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-13 15:03:36,886 INFO [Listener at localhost.localdomain/39751] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 15:03:36,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-13 15:03:36,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 15:03:36,899 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300616898"}]},"ts":"1676300616898"} 2023-02-13 15:03:36,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 15:03:36,901 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 15:03:36,903 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 15:03:36,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=644cc8d2fca28f19448afd0116f7096e, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a0dd5d81ec4ea6ca6653c4055ae0a5ce, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0757ff25434fd256d87f44bc8a24d25a, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7683b16f577bf67fd24f66bc0dc0597e, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e3f636a3e94426a070b352ced6ac9e4d, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=189cc975fd2f2560d5d2ef65ad524252, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f82b0422a13fa7e1368d4266d0ffa03f, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ac0d2a60686cec63e9906124fbe168b, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5a928f483bd149d990b76ca7b06d09fb, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9d8058518fb19b4163360de6733e9693, UNASSIGN}] 2023-02-13 15:03:36,910 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=189cc975fd2f2560d5d2ef65ad524252, UNASSIGN 2023-02-13 15:03:36,911 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7683b16f577bf67fd24f66bc0dc0597e, UNASSIGN 2023-02-13 15:03:36,911 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0757ff25434fd256d87f44bc8a24d25a, UNASSIGN 2023-02-13 15:03:36,911 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e3f636a3e94426a070b352ced6ac9e4d, UNASSIGN 2023-02-13 15:03:36,911 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9d8058518fb19b4163360de6733e9693, UNASSIGN 2023-02-13 15:03:36,912 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0757ff25434fd256d87f44bc8a24d25a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:36,912 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7683b16f577bf67fd24f66bc0dc0597e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:36,912 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=189cc975fd2f2560d5d2ef65ad524252, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:36,912 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e3f636a3e94426a070b352ced6ac9e4d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:36,912 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616912"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616912"}]},"ts":"1676300616912"} 2023-02-13 15:03:36,912 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616912"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616912"}]},"ts":"1676300616912"} 2023-02-13 15:03:36,912 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616912"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616912"}]},"ts":"1676300616912"} 2023-02-13 15:03:36,912 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616912"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616912"}]},"ts":"1676300616912"} 2023-02-13 15:03:36,913 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9d8058518fb19b4163360de6733e9693, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:36,913 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300616913"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616913"}]},"ts":"1676300616913"} 2023-02-13 15:03:36,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 0757ff25434fd256d87f44bc8a24d25a, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:36,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=39, state=RUNNABLE; CloseRegionProcedure 189cc975fd2f2560d5d2ef65ad524252, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:36,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 7683b16f577bf67fd24f66bc0dc0597e, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:36,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=38, state=RUNNABLE; CloseRegionProcedure e3f636a3e94426a070b352ced6ac9e4d, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:36,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 9d8058518fb19b4163360de6733e9693, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:36,926 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5a928f483bd149d990b76ca7b06d09fb, UNASSIGN 2023-02-13 15:03:36,927 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ac0d2a60686cec63e9906124fbe168b, UNASSIGN 2023-02-13 15:03:36,927 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f82b0422a13fa7e1368d4266d0ffa03f, UNASSIGN 2023-02-13 15:03:36,927 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a0dd5d81ec4ea6ca6653c4055ae0a5ce, UNASSIGN 2023-02-13 15:03:36,927 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=644cc8d2fca28f19448afd0116f7096e, UNASSIGN 2023-02-13 15:03:36,928 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5a928f483bd149d990b76ca7b06d09fb, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:36,928 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9ac0d2a60686cec63e9906124fbe168b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:36,928 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616928"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616928"}]},"ts":"1676300616928"} 2023-02-13 15:03:36,928 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616928"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616928"}]},"ts":"1676300616928"} 2023-02-13 15:03:36,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f82b0422a13fa7e1368d4266d0ffa03f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:36,928 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=a0dd5d81ec4ea6ca6653c4055ae0a5ce, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:36,929 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616928"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616928"}]},"ts":"1676300616928"} 2023-02-13 15:03:36,929 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300616928"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616928"}]},"ts":"1676300616928"} 2023-02-13 15:03:36,929 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=644cc8d2fca28f19448afd0116f7096e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:36,929 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300616928"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300616928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300616928"}]},"ts":"1676300616928"} 2023-02-13 15:03:36,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 5a928f483bd149d990b76ca7b06d09fb, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:36,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=40, state=RUNNABLE; CloseRegionProcedure f82b0422a13fa7e1368d4266d0ffa03f, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:36,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure a0dd5d81ec4ea6ca6653c4055ae0a5ce, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:36,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=41, state=RUNNABLE; CloseRegionProcedure 9ac0d2a60686cec63e9906124fbe168b, server=jenkins-hbase20.apache.org,32817,1676300604733}] 2023-02-13 15:03:36,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 644cc8d2fca28f19448afd0116f7096e, server=jenkins-hbase20.apache.org,34169,1676300604777}] 2023-02-13 15:03:37,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 15:03:37,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 0757ff25434fd256d87f44bc8a24d25a, disabling compactions & flushes 2023-02-13 15:03:37,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. after waiting 0 ms 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:37,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 644cc8d2fca28f19448afd0116f7096e, disabling compactions & flushes 2023-02-13 15:03:37,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. after waiting 0 ms 2023-02-13 15:03:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:37,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 15:03:37,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a. 2023-02-13 15:03:37,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e. 2023-02-13 15:03:37,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 0757ff25434fd256d87f44bc8a24d25a: Waiting for close lock at 1676300617079Running coprocessor pre-close hooks at 1676300617079Disabling compacts and flushes for region at 1676300617079Disabling writes for close at 1676300617079Writing region close event to WAL at 1676300617086 (+7 ms)Running coprocessor post-close hooks at 1676300617096 (+10 ms)Closed at 1676300617097 (+1 ms) 2023-02-13 15:03:37,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 644cc8d2fca28f19448afd0116f7096e: Waiting for close lock at 1676300617079Running coprocessor pre-close hooks at 1676300617079Disabling compacts and flushes for region at 1676300617079Disabling writes for close at 1676300617079Writing region close event to WAL at 1676300617081 (+2 ms)Running coprocessor post-close hooks at 1676300617096 (+15 ms)Closed at 1676300617097 (+1 ms) 2023-02-13 15:03:37,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:37,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:37,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5a928f483bd149d990b76ca7b06d09fb, disabling compactions & flushes 2023-02-13 15:03:37,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:37,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:37,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. after waiting 0 ms 2023-02-13 15:03:37,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:37,100 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=644cc8d2fca28f19448afd0116f7096e, regionState=CLOSED 2023-02-13 15:03:37,100 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300617100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617100"}]},"ts":"1676300617100"} 2023-02-13 15:03:37,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:37,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:37,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e3f636a3e94426a070b352ced6ac9e4d, disabling compactions & flushes 2023-02-13 15:03:37,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:37,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:37,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. after waiting 0 ms 2023-02-13 15:03:37,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:37,102 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0757ff25434fd256d87f44bc8a24d25a, regionState=CLOSED 2023-02-13 15:03:37,103 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617102"}]},"ts":"1676300617102"} 2023-02-13 15:03:37,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-13 15:03:37,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 644cc8d2fca28f19448afd0116f7096e, server=jenkins-hbase20.apache.org,34169,1676300604777 in 169 msec 2023-02-13 15:03:37,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-13 15:03:37,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 0757ff25434fd256d87f44bc8a24d25a, server=jenkins-hbase20.apache.org,32817,1676300604733 in 192 msec 2023-02-13 15:03:37,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=644cc8d2fca28f19448afd0116f7096e, UNASSIGN in 204 msec 2023-02-13 15:03:37,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0757ff25434fd256d87f44bc8a24d25a, UNASSIGN in 204 msec 2023-02-13 15:03:37,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb. 2023-02-13 15:03:37,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5a928f483bd149d990b76ca7b06d09fb: Waiting for close lock at 1676300617100Running coprocessor pre-close hooks at 1676300617100Disabling compacts and flushes for region at 1676300617100Disabling writes for close at 1676300617100Writing region close event to WAL at 1676300617104 (+4 ms)Running coprocessor post-close hooks at 1676300617114 (+10 ms)Closed at 1676300617115 (+1 ms) 2023-02-13 15:03:37,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:37,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:37,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing a0dd5d81ec4ea6ca6653c4055ae0a5ce, disabling compactions & flushes 2023-02-13 15:03:37,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:37,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:37,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. after waiting 0 ms 2023-02-13 15:03:37,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:37,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5a928f483bd149d990b76ca7b06d09fb, regionState=CLOSED 2023-02-13 15:03:37,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617119"}]},"ts":"1676300617119"} 2023-02-13 15:03:37,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-13 15:03:37,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 5a928f483bd149d990b76ca7b06d09fb, server=jenkins-hbase20.apache.org,34169,1676300604777 in 191 msec 2023-02-13 15:03:37,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5a928f483bd149d990b76ca7b06d09fb, UNASSIGN in 216 msec 2023-02-13 15:03:37,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d. 2023-02-13 15:03:37,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e3f636a3e94426a070b352ced6ac9e4d: Waiting for close lock at 1676300617101Running coprocessor pre-close hooks at 1676300617101Disabling compacts and flushes for region at 1676300617101Disabling writes for close at 1676300617102 (+1 ms)Writing region close event to WAL at 1676300617113 (+11 ms)Running coprocessor post-close hooks at 1676300617128 (+15 ms)Closed at 1676300617133 (+5 ms) 2023-02-13 15:03:37,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:37,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:37,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9ac0d2a60686cec63e9906124fbe168b, disabling compactions & flushes 2023-02-13 15:03:37,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:37,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:37,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e3f636a3e94426a070b352ced6ac9e4d, regionState=CLOSED 2023-02-13 15:03:37,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. after waiting 0 ms 2023-02-13 15:03:37,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:37,136 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617136"}]},"ts":"1676300617136"} 2023-02-13 15:03:37,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce. 2023-02-13 15:03:37,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for a0dd5d81ec4ea6ca6653c4055ae0a5ce: Waiting for close lock at 1676300617118Running coprocessor pre-close hooks at 1676300617118Disabling compacts and flushes for region at 1676300617118Disabling writes for close at 1676300617118Writing region close event to WAL at 1676300617133 (+15 ms)Running coprocessor post-close hooks at 1676300617144 (+11 ms)Closed at 1676300617144 2023-02-13 15:03:37,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=38 2023-02-13 15:03:37,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=38, state=SUCCESS; CloseRegionProcedure e3f636a3e94426a070b352ced6ac9e4d, server=jenkins-hbase20.apache.org,32817,1676300604733 in 221 msec 2023-02-13 15:03:37,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:37,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:37,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 189cc975fd2f2560d5d2ef65ad524252, disabling compactions & flushes 2023-02-13 15:03:37,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:37,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:37,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. after waiting 0 ms 2023-02-13 15:03:37,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:37,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e3f636a3e94426a070b352ced6ac9e4d, UNASSIGN in 240 msec 2023-02-13 15:03:37,147 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=a0dd5d81ec4ea6ca6653c4055ae0a5ce, regionState=CLOSED 2023-02-13 15:03:37,147 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617147"}]},"ts":"1676300617147"} 2023-02-13 15:03:37,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b. 2023-02-13 15:03:37,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9ac0d2a60686cec63e9906124fbe168b: Waiting for close lock at 1676300617136Running coprocessor pre-close hooks at 1676300617136Disabling compacts and flushes for region at 1676300617136Disabling writes for close at 1676300617136Writing region close event to WAL at 1676300617144 (+8 ms)Running coprocessor post-close hooks at 1676300617150 (+6 ms)Closed at 1676300617150 2023-02-13 15:03:37,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:37,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:37,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7683b16f577bf67fd24f66bc0dc0597e, disabling compactions & flushes 2023-02-13 15:03:37,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:37,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:37,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. after waiting 0 ms 2023-02-13 15:03:37,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:37,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9ac0d2a60686cec63e9906124fbe168b, regionState=CLOSED 2023-02-13 15:03:37,153 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617153"}]},"ts":"1676300617153"} 2023-02-13 15:03:37,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-13 15:03:37,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure a0dd5d81ec4ea6ca6653c4055ae0a5ce, server=jenkins-hbase20.apache.org,34169,1676300604777 in 216 msec 2023-02-13 15:03:37,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252. 2023-02-13 15:03:37,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 189cc975fd2f2560d5d2ef65ad524252: Waiting for close lock at 1676300617147Running coprocessor pre-close hooks at 1676300617147Disabling compacts and flushes for region at 1676300617147Disabling writes for close at 1676300617147Writing region close event to WAL at 1676300617149 (+2 ms)Running coprocessor post-close hooks at 1676300617160 (+11 ms)Closed at 1676300617160 2023-02-13 15:03:37,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a0dd5d81ec4ea6ca6653c4055ae0a5ce, UNASSIGN in 249 msec 2023-02-13 15:03:37,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:37,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:37,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f82b0422a13fa7e1368d4266d0ffa03f, disabling compactions & flushes 2023-02-13 15:03:37,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:37,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:37,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. after waiting 0 ms 2023-02-13 15:03:37,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:37,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=41 2023-02-13 15:03:37,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=41, state=SUCCESS; CloseRegionProcedure 9ac0d2a60686cec63e9906124fbe168b, server=jenkins-hbase20.apache.org,32817,1676300604733 in 220 msec 2023-02-13 15:03:37,165 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=189cc975fd2f2560d5d2ef65ad524252, regionState=CLOSED 2023-02-13 15:03:37,165 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617165"}]},"ts":"1676300617165"} 2023-02-13 15:03:37,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ac0d2a60686cec63e9906124fbe168b, UNASSIGN in 259 msec 2023-02-13 15:03:37,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e. 2023-02-13 15:03:37,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7683b16f577bf67fd24f66bc0dc0597e: Waiting for close lock at 1676300617153Running coprocessor pre-close hooks at 1676300617153Disabling compacts and flushes for region at 1676300617153Disabling writes for close at 1676300617153Writing region close event to WAL at 1676300617160 (+7 ms)Running coprocessor post-close hooks at 1676300617168 (+8 ms)Closed at 1676300617169 (+1 ms) 2023-02-13 15:03:37,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=39 2023-02-13 15:03:37,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=39, state=SUCCESS; CloseRegionProcedure 189cc975fd2f2560d5d2ef65ad524252, server=jenkins-hbase20.apache.org,34169,1676300604777 in 251 msec 2023-02-13 15:03:37,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:37,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:37,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9d8058518fb19b4163360de6733e9693, disabling compactions & flushes 2023-02-13 15:03:37,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:37,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:37,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. after waiting 0 ms 2023-02-13 15:03:37,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:37,173 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7683b16f577bf67fd24f66bc0dc0597e, regionState=CLOSED 2023-02-13 15:03:37,173 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617173"}]},"ts":"1676300617173"} 2023-02-13 15:03:37,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=189cc975fd2f2560d5d2ef65ad524252, UNASSIGN in 266 msec 2023-02-13 15:03:37,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-13 15:03:37,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 7683b16f577bf67fd24f66bc0dc0597e, server=jenkins-hbase20.apache.org,32817,1676300604733 in 258 msec 2023-02-13 15:03:37,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7683b16f577bf67fd24f66bc0dc0597e, UNASSIGN in 274 msec 2023-02-13 15:03:37,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 15:03:37,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:37,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693. 2023-02-13 15:03:37,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f. 2023-02-13 15:03:37,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9d8058518fb19b4163360de6733e9693: Waiting for close lock at 1676300617172Running coprocessor pre-close hooks at 1676300617172Disabling compacts and flushes for region at 1676300617172Disabling writes for close at 1676300617172Writing region close event to WAL at 1676300617173 (+1 ms)Running coprocessor post-close hooks at 1676300617185 (+12 ms)Closed at 1676300617186 (+1 ms) 2023-02-13 15:03:37,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f82b0422a13fa7e1368d4266d0ffa03f: Waiting for close lock at 1676300617163Running coprocessor pre-close hooks at 1676300617163Disabling compacts and flushes for region at 1676300617163Disabling writes for close at 1676300617163Writing region close event to WAL at 1676300617171 (+8 ms)Running coprocessor post-close hooks at 1676300617186 (+15 ms)Closed at 1676300617186 2023-02-13 15:03:37,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:37,189 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f82b0422a13fa7e1368d4266d0ffa03f, regionState=CLOSED 2023-02-13 15:03:37,189 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300617189"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617189"}]},"ts":"1676300617189"} 2023-02-13 15:03:37,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:37,190 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9d8058518fb19b4163360de6733e9693, regionState=CLOSED 2023-02-13 15:03:37,190 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300617190"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300617190"}]},"ts":"1676300617190"} 2023-02-13 15:03:37,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=40 2023-02-13 15:03:37,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=40, state=SUCCESS; CloseRegionProcedure f82b0422a13fa7e1368d4266d0ffa03f, server=jenkins-hbase20.apache.org,34169,1676300604777 in 258 msec 2023-02-13 15:03:37,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-13 15:03:37,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 9d8058518fb19b4163360de6733e9693, server=jenkins-hbase20.apache.org,32817,1676300604733 in 272 msec 2023-02-13 15:03:37,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f82b0422a13fa7e1368d4266d0ffa03f, UNASSIGN in 289 msec 2023-02-13 15:03:37,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-13 15:03:37,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9d8058518fb19b4163360de6733e9693, UNASSIGN in 288 msec 2023-02-13 15:03:37,198 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300617198"}]},"ts":"1676300617198"} 2023-02-13 15:03:37,200 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 15:03:37,202 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 15:03:37,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 15:03:37,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 315 msec 2023-02-13 15:03:37,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 15:03:37,507 INFO [Listener at localhost.localdomain/39751] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-13 15:03:37,512 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-13 15:03:37,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:03:37,522 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:03:37,524 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:03:37,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:37,546 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:37,567 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/recovered.edits] 2023-02-13 15:03:37,567 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/recovered.edits] 2023-02-13 15:03:37,567 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/recovered.edits] 2023-02-13 15:03:37,567 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/recovered.edits] 2023-02-13 15:03:37,567 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/recovered.edits] 2023-02-13 15:03:37,567 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/recovered.edits] 2023-02-13 15:03:37,568 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/recovered.edits] 2023-02-13 15:03:37,569 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/recovered.edits] 2023-02-13 15:03:37,580 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/9c48eebd65b04bbd882866e273566d98 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/9c48eebd65b04bbd882866e273566d98 2023-02-13 15:03:37,580 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/21421429f4814699badd4498745e5c12 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/21421429f4814699badd4498745e5c12 2023-02-13 15:03:37,581 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/065a82b968e742dfbde73ef9a2defcd2 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/065a82b968e742dfbde73ef9a2defcd2 2023-02-13 15:03:37,585 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/558cdb419573413bb4225eca6faa40b7 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/558cdb419573413bb4225eca6faa40b7 2023-02-13 15:03:37,586 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/84e6aeef6ef844cf9865b12b59715f59 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/84e6aeef6ef844cf9865b12b59715f59 2023-02-13 15:03:37,596 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/5cadc0d064984ee9878314a89540210d to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/5cadc0d064984ee9878314a89540210d 2023-02-13 15:03:37,597 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/3ab12d08ad3a4aaf90c82f200a821990 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f1/3ab12d08ad3a4aaf90c82f200a821990 2023-02-13 15:03:37,597 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/973ff68cf6804868b6cb5fd23fbbec23 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/973ff68cf6804868b6cb5fd23fbbec23 2023-02-13 15:03:37,597 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/a88eb4542d1c468992d74a700243881d to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f1/a88eb4542d1c468992d74a700243881d 2023-02-13 15:03:37,598 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/1af4bf7eeb5a4f359b82cc8c228b826f to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f1/1af4bf7eeb5a4f359b82cc8c228b826f 2023-02-13 15:03:37,598 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/975b284467424649955d494a0606c4cc to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f1/975b284467424649955d494a0606c4cc 2023-02-13 15:03:37,599 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/a3d8f512a24942ea880404331a39e0ff to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f1/a3d8f512a24942ea880404331a39e0ff 2023-02-13 15:03:37,599 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/recovered.edits/6.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e/recovered.edits/6.seqid 2023-02-13 15:03:37,601 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/f51cc099d85742e3878544f8913f366d to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f1/f51cc099d85742e3878544f8913f366d 2023-02-13 15:03:37,601 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/644cc8d2fca28f19448afd0116f7096e 2023-02-13 15:03:37,601 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:37,602 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/e21873e3f4f541dea1ad933a850f5847 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f1/e21873e3f4f541dea1ad933a850f5847 2023-02-13 15:03:37,606 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/347d2fcfafef447d87f6aa6e144f09ea to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/347d2fcfafef447d87f6aa6e144f09ea 2023-02-13 15:03:37,606 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/a7e2ebd9e117467199cd40185420df58 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/a7e2ebd9e117467199cd40185420df58 2023-02-13 15:03:37,607 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/a4925420f0114ae3ac4486770ae14d53 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/a4925420f0114ae3ac4486770ae14d53 2023-02-13 15:03:37,608 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/recovered.edits] 2023-02-13 15:03:37,609 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/0b25feeb51cf45e68f2f45fa6e7cb004 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/0b25feeb51cf45e68f2f45fa6e7cb004 2023-02-13 15:03:37,610 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/8c00031e4bca4dcb8fb1d42024b4fb92 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/8c00031e4bca4dcb8fb1d42024b4fb92 2023-02-13 15:03:37,610 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/e2804b30327f4a489813e3d6259c73a8 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/f2/e2804b30327f4a489813e3d6259c73a8 2023-02-13 15:03:37,610 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/61ef4413d599404da977550f351ae332 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/61ef4413d599404da977550f351ae332 2023-02-13 15:03:37,611 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/d4fcb8320960405893d17c87933ac9c4 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/f2/d4fcb8320960405893d17c87933ac9c4 2023-02-13 15:03:37,611 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/acee633ac2f44aba9c858aebae167ef8 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/f2/acee633ac2f44aba9c858aebae167ef8 2023-02-13 15:03:37,612 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/bd5400237aba485ebaba4d3dce97e552 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/f2/bd5400237aba485ebaba4d3dce97e552 2023-02-13 15:03:37,612 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/6c74514479fa4d0284eae2b53e1ae4c1 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/6c74514479fa4d0284eae2b53e1ae4c1 2023-02-13 15:03:37,613 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/cef79c90e67647e4a8412c4432355c58 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/f2/cef79c90e67647e4a8412c4432355c58 2023-02-13 15:03:37,614 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/db7c0902c1ef40d4b5e2c665506b6802 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/f2/db7c0902c1ef40d4b5e2c665506b6802 2023-02-13 15:03:37,617 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/bd74f8b52f0e4afaba1a9d45f2bc89fe to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/f2/bd74f8b52f0e4afaba1a9d45f2bc89fe 2023-02-13 15:03:37,618 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a/recovered.edits/12.seqid 2023-02-13 15:03:37,623 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/0757ff25434fd256d87f44bc8a24d25a 2023-02-13 15:03:37,623 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:37,623 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252/recovered.edits/12.seqid 2023-02-13 15:03:37,623 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/bd6ec1f0958a4aa98b73e613ca42c860 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/bd6ec1f0958a4aa98b73e613ca42c860 2023-02-13 15:03:37,624 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b/recovered.edits/12.seqid 2023-02-13 15:03:37,624 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/189cc975fd2f2560d5d2ef65ad524252 2023-02-13 15:03:37,625 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f/recovered.edits/12.seqid 2023-02-13 15:03:37,625 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce/recovered.edits/12.seqid 2023-02-13 15:03:37,625 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/f82b0422a13fa7e1368d4266d0ffa03f 2023-02-13 15:03:37,626 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/a0dd5d81ec4ea6ca6653c4055ae0a5ce 2023-02-13 15:03:37,626 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d/recovered.edits/12.seqid 2023-02-13 15:03:37,627 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9ac0d2a60686cec63e9906124fbe168b 2023-02-13 15:03:37,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f1, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/f2, FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/recovered.edits] 2023-02-13 15:03:37,627 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/e3f636a3e94426a070b352ced6ac9e4d 2023-02-13 15:03:37,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 15:03:37,628 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e/recovered.edits/12.seqid 2023-02-13 15:03:37,628 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/c3c28e4e516f4f2a8e50403d022cc04f to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f1/c3c28e4e516f4f2a8e50403d022cc04f 2023-02-13 15:03:37,628 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/7683b16f577bf67fd24f66bc0dc0597e 2023-02-13 15:03:37,632 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/0f28189932154d9b917d46096ca863ea to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/0f28189932154d9b917d46096ca863ea 2023-02-13 15:03:37,633 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/21eaddb46f024cde9faea537d4171292 to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/f2/21eaddb46f024cde9faea537d4171292 2023-02-13 15:03:37,633 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/recovered.edits/6.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693/recovered.edits/6.seqid 2023-02-13 15:03:37,634 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/9d8058518fb19b4163360de6733e9693 2023-02-13 15:03:37,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/recovered.edits/12.seqid to hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/archive/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb/recovered.edits/12.seqid 2023-02-13 15:03:37,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/.tmp/data/default/testWithMapReduce/5a928f483bd149d990b76ca7b06d09fb 2023-02-13 15:03:37,637 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 15:03:37,640 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:03:37,669 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-13 15:03:37,674 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 15:03:37,675 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:03:37,675 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,677 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300617676"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,679 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 15:03:37,679 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 644cc8d2fca28f19448afd0116f7096e, NAME => 'testWithMapReduce,,1676300608614.644cc8d2fca28f19448afd0116f7096e.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => a0dd5d81ec4ea6ca6653c4055ae0a5ce, NAME => 'testWithMapReduce,aaa,1676300608614.a0dd5d81ec4ea6ca6653c4055ae0a5ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 0757ff25434fd256d87f44bc8a24d25a, NAME => 'testWithMapReduce,d\x84\x84,1676300608614.0757ff25434fd256d87f44bc8a24d25a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 7683b16f577bf67fd24f66bc0dc0597e, NAME => 'testWithMapReduce,g\xA7\xA7,1676300608614.7683b16f577bf67fd24f66bc0dc0597e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => e3f636a3e94426a070b352ced6ac9e4d, NAME => 'testWithMapReduce,j\xCA\xCA,1676300608614.e3f636a3e94426a070b352ced6ac9e4d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 189cc975fd2f2560d5d2ef65ad524252, NAME => 'testWithMapReduce,m\xED\xED,1676300608614.189cc975fd2f2560d5d2ef65ad524252.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => f82b0422a13fa7e1368d4266d0ffa03f, NAME => 'testWithMapReduce,q\x11\x10,1676300608614.f82b0422a13fa7e1368d4266d0ffa03f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 9ac0d2a60686cec63e9906124fbe168b, NAME => 'testWithMapReduce,t43,1676300608614.9ac0d2a60686cec63e9906124fbe168b.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 5a928f483bd149d990b76ca7b06d09fb, NAME => 'testWithMapReduce,wWV,1676300608614.5a928f483bd149d990b76ca7b06d09fb.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 9d8058518fb19b4163360de6733e9693, NAME => 'testWithMapReduce,zz{,1676300608614.9d8058518fb19b4163360de6733e9693.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 15:03:37,679 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 15:03:37,680 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676300617680"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:37,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 15:03:37,684 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:03:37,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 171 msec 2023-02-13 15:03:37,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36165] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 15:03:37,829 INFO [Listener at localhost.localdomain/39751] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-13 15:03:37,830 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 15:03:37,830 INFO [Listener at localhost.localdomain/39751] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 15:03:37,830 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3dba84f6 to 127.0.0.1:53165 2023-02-13 15:03:37,830 DEBUG [Listener at localhost.localdomain/39751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:37,830 DEBUG [Listener at localhost.localdomain/39751] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 15:03:37,830 DEBUG [Listener at localhost.localdomain/39751] util.JVMClusterUtil(257): Found active master hash=1914163511, stopped=false 2023-02-13 15:03:37,830 INFO [Listener at localhost.localdomain/39751] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:37,832 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:37,832 INFO [Listener at localhost.localdomain/39751] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 15:03:37,832 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:37,832 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:37,833 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:37,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:37,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:37,834 DEBUG [Listener at localhost.localdomain/39751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d6aa119 to 127.0.0.1:53165 2023-02-13 15:03:37,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:37,834 DEBUG [Listener at localhost.localdomain/39751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:37,835 INFO [Listener at localhost.localdomain/39751] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,32817,1676300604733' ***** 2023-02-13 15:03:37,835 INFO [Listener at localhost.localdomain/39751] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:37,835 INFO [Listener at localhost.localdomain/39751] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34169,1676300604777' ***** 2023-02-13 15:03:37,835 INFO [Listener at localhost.localdomain/39751] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:37,835 INFO [RS:1;jenkins-hbase20:34169] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:37,835 INFO [RS:0;jenkins-hbase20:32817] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:37,835 INFO [RS:1;jenkins-hbase20:34169] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:37,835 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:37,835 INFO [RS:1;jenkins-hbase20:34169] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:37,836 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:37,836 INFO [RS:0;jenkins-hbase20:32817] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:37,836 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:37,836 INFO [RS:0;jenkins-hbase20:32817] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:37,836 DEBUG [RS:1;jenkins-hbase20:34169] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ad3a5ef to 127.0.0.1:53165 2023-02-13 15:03:37,836 DEBUG [RS:1;jenkins-hbase20:34169] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:37,836 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(3304): Received CLOSE for d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:37,836 INFO [RS:1;jenkins-hbase20:34169] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:37,837 INFO [RS:1;jenkins-hbase20:34169] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:37,837 INFO [RS:1;jenkins-hbase20:34169] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:37,837 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:37,837 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 15:03:37,837 DEBUG [RS:0;jenkins-hbase20:32817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47052887 to 127.0.0.1:53165 2023-02-13 15:03:37,837 DEBUG [RS:0;jenkins-hbase20:32817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:37,837 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:03:37,837 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:03:37,837 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 15:03:37,838 DEBUG [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 15:03:37,837 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1479): Online Regions={d6e751fa185d76b0d3c831c155a18ab3=hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3.} 2023-02-13 15:03:37,838 DEBUG [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1505): Waiting on d6e751fa185d76b0d3c831c155a18ab3 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d6e751fa185d76b0d3c831c155a18ab3, disabling compactions & flushes 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:37,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:37,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. after waiting 0 ms 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:37,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:37,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing d6e751fa185d76b0d3c831c155a18ab3 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 15:03:37,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.32 KB heapSize=40.20 KB 2023-02-13 15:03:37,841 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:37,856 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:37,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/.tmp/info/1f83e37f0d004316b49765fddebb223d 2023-02-13 15:03:37,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.11 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/.tmp/info/2c06ffb36d1d41d3894245161891f623 2023-02-13 15:03:37,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/.tmp/info/1f83e37f0d004316b49765fddebb223d as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/info/1f83e37f0d004316b49765fddebb223d 2023-02-13 15:03:37,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/info/1f83e37f0d004316b49765fddebb223d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 15:03:37,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c06ffb36d1d41d3894245161891f623 2023-02-13 15:03:37,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d6e751fa185d76b0d3c831c155a18ab3 in 39ms, sequenceid=6, compaction requested=false 2023-02-13 15:03:37,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/namespace/d6e751fa185d76b0d3c831c155a18ab3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 15:03:37,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:37,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d6e751fa185d76b0d3c831c155a18ab3: Waiting for close lock at 1676300617837Running coprocessor pre-close hooks at 1676300617837Disabling compacts and flushes for region at 1676300617837Disabling writes for close at 1676300617839 (+2 ms)Obtaining lock to block concurrent updates at 1676300617840 (+1 ms)Preparing flush snapshotting stores in d6e751fa185d76b0d3c831c155a18ab3 at 1676300617840Finished memstore snapshotting hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676300617840Flushing stores of hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. at 1676300617840Flushing d6e751fa185d76b0d3c831c155a18ab3/info: creating writer at 1676300617841 (+1 ms)Flushing d6e751fa185d76b0d3c831c155a18ab3/info: appending metadata at 1676300617844 (+3 ms)Flushing d6e751fa185d76b0d3c831c155a18ab3/info: closing flushed file at 1676300617844Flushing d6e751fa185d76b0d3c831c155a18ab3/info: reopening flushed file at 1676300617870 (+26 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d6e751fa185d76b0d3c831c155a18ab3 in 39ms, sequenceid=6, compaction requested=false at 1676300617879 (+9 ms)Writing region close event to WAL at 1676300617888 (+9 ms)Running coprocessor post-close hooks at 1676300617900 (+12 ms)Closed at 1676300617907 (+7 ms) 2023-02-13 15:03:37,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676300607688.d6e751fa185d76b0d3c831c155a18ab3. 2023-02-13 15:03:37,917 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/.tmp/rep_barrier/07255b1384084f0681ada2f0d08440c8 2023-02-13 15:03:37,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07255b1384084f0681ada2f0d08440c8 2023-02-13 15:03:37,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/.tmp/table/441f7cfb5a3348e5aa64cce6bc9d4def 2023-02-13 15:03:37,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 441f7cfb5a3348e5aa64cce6bc9d4def 2023-02-13 15:03:37,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/.tmp/info/2c06ffb36d1d41d3894245161891f623 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/info/2c06ffb36d1d41d3894245161891f623 2023-02-13 15:03:37,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c06ffb36d1d41d3894245161891f623 2023-02-13 15:03:37,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/info/2c06ffb36d1d41d3894245161891f623, entries=30, sequenceid=57, filesize=7.9 K 2023-02-13 15:03:37,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/.tmp/rep_barrier/07255b1384084f0681ada2f0d08440c8 as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/rep_barrier/07255b1384084f0681ada2f0d08440c8 2023-02-13 15:03:37,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07255b1384084f0681ada2f0d08440c8 2023-02-13 15:03:37,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/rep_barrier/07255b1384084f0681ada2f0d08440c8, entries=10, sequenceid=57, filesize=5.9 K 2023-02-13 15:03:37,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/.tmp/table/441f7cfb5a3348e5aa64cce6bc9d4def as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/table/441f7cfb5a3348e5aa64cce6bc9d4def 2023-02-13 15:03:37,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 441f7cfb5a3348e5aa64cce6bc9d4def 2023-02-13 15:03:37,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/table/441f7cfb5a3348e5aa64cce6bc9d4def, entries=13, sequenceid=57, filesize=5.9 K 2023-02-13 15:03:37,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.32 KB/24908, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 136ms, sequenceid=57, compaction requested=false 2023-02-13 15:03:37,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 15:03:37,984 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:03:37,985 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:37,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300617837Running coprocessor pre-close hooks at 1676300617837Disabling compacts and flushes for region at 1676300617837Disabling writes for close at 1676300617839 (+2 ms)Obtaining lock to block concurrent updates at 1676300617840 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676300617840Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24908, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676300617840Flushing stores of hbase:meta,,1.1588230740 at 1676300617840Flushing 1588230740/info: creating writer at 1676300617841 (+1 ms)Flushing 1588230740/info: appending metadata at 1676300617846 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676300617846Flushing 1588230740/rep_barrier: creating writer at 1676300617879 (+33 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676300617888 (+9 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676300617888Flushing 1588230740/table: creating writer at 1676300617924 (+36 ms)Flushing 1588230740/table: appending metadata at 1676300617928 (+4 ms)Flushing 1588230740/table: closing flushed file at 1676300617928Flushing 1588230740/info: reopening flushed file at 1676300617954 (+26 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676300617962 (+8 ms)Flushing 1588230740/table: reopening flushed file at 1676300617970 (+8 ms)Finished flush of dataSize ~24.32 KB/24908, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 136ms, sequenceid=57, compaction requested=false at 1676300617976 (+6 ms)Writing region close event to WAL at 1676300617980 (+4 ms)Running coprocessor post-close hooks at 1676300617984 (+4 ms)Closed at 1676300617985 (+1 ms) 2023-02-13 15:03:37,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:38,038 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34169,1676300604777; all regions closed. 2023-02-13 15:03:38,038 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,32817,1676300604733; all regions closed. 2023-02-13 15:03:38,059 DEBUG [RS:1;jenkins-hbase20:34169] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/oldWALs 2023-02-13 15:03:38,059 INFO [RS:1;jenkins-hbase20:34169] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34169%2C1676300604777.meta:.meta(num 1676300607444) 2023-02-13 15:03:38,059 DEBUG [RS:0;jenkins-hbase20:32817] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/oldWALs 2023-02-13 15:03:38,059 INFO [RS:0;jenkins-hbase20:32817] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C32817%2C1676300604733:(num 1676300608154) 2023-02-13 15:03:38,059 DEBUG [RS:0;jenkins-hbase20:32817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:38,059 INFO [RS:0;jenkins-hbase20:32817] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:38,060 INFO [RS:0;jenkins-hbase20:32817] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:38,060 INFO [RS:0;jenkins-hbase20:32817] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:38,060 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:38,060 INFO [RS:0;jenkins-hbase20:32817] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:38,060 INFO [RS:0;jenkins-hbase20:32817] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:38,061 INFO [RS:0;jenkins-hbase20:32817] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:32817 2023-02-13 15:03:38,065 DEBUG [RS:1;jenkins-hbase20:34169] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/oldWALs 2023-02-13 15:03:38,065 INFO [RS:1;jenkins-hbase20:34169] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34169%2C1676300604777:(num 1676300608154) 2023-02-13 15:03:38,066 DEBUG [RS:1;jenkins-hbase20:34169] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:38,066 INFO [RS:1;jenkins-hbase20:34169] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:38,067 INFO [RS:1;jenkins-hbase20:34169] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:38,068 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:38,068 INFO [RS:1;jenkins-hbase20:34169] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34169 2023-02-13 15:03:38,072 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:38,072 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32817,1676300604733 2023-02-13 15:03:38,072 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:38,072 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f4ed78b rejected from java.util.concurrent.ThreadPoolExecutor@7b715cba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,073 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:38,073 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:38,073 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fc8ad3 rejected from java.util.concurrent.ThreadPoolExecutor@7b715cba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,073 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:38,073 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e62eede rejected from java.util.concurrent.ThreadPoolExecutor@7b715cba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,073 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34169,1676300604777 2023-02-13 15:03:38,073 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@11625ddc rejected from java.util.concurrent.ThreadPoolExecutor@155ddb28[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,073 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,32817,1676300604733] 2023-02-13 15:03:38,073 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,32817,1676300604733; numProcessing=1 2023-02-13 15:03:38,074 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,32817,1676300604733 already deleted, retry=false 2023-02-13 15:03:38,074 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,32817,1676300604733 expired; onlineServers=1 2023-02-13 15:03:38,074 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34169,1676300604777] 2023-02-13 15:03:38,074 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34169,1676300604777; numProcessing=2 2023-02-13 15:03:38,075 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34169,1676300604777 already deleted, retry=false 2023-02-13 15:03:38,075 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34169,1676300604777 expired; onlineServers=0 2023-02-13 15:03:38,075 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,36165,1676300603732' ***** 2023-02-13 15:03:38,075 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 15:03:38,076 DEBUG [M:0;jenkins-hbase20:36165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@332adb0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:38,076 INFO [M:0;jenkins-hbase20:36165] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,36165,1676300603732 2023-02-13 15:03:38,076 INFO [M:0;jenkins-hbase20:36165] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,36165,1676300603732; all regions closed. 2023-02-13 15:03:38,076 DEBUG [M:0;jenkins-hbase20:36165] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:38,076 DEBUG [M:0;jenkins-hbase20:36165] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 15:03:38,076 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 15:03:38,077 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300605949] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300605949,5,FailOnTimeoutGroup] 2023-02-13 15:03:38,076 DEBUG [M:0;jenkins-hbase20:36165] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 15:03:38,077 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300605952] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300605952,5,FailOnTimeoutGroup] 2023-02-13 15:03:38,077 INFO [M:0;jenkins-hbase20:36165] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 15:03:38,077 INFO [M:0;jenkins-hbase20:36165] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 15:03:38,078 INFO [M:0;jenkins-hbase20:36165] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 15:03:38,078 DEBUG [M:0;jenkins-hbase20:36165] master.HMaster(1502): Stopping service threads 2023-02-13 15:03:38,078 INFO [M:0;jenkins-hbase20:36165] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 15:03:38,078 ERROR [M:0;jenkins-hbase20:36165] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-13 15:03:38,079 INFO [M:0;jenkins-hbase20:36165] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 15:03:38,079 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 15:03:38,079 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:38,079 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:38,079 DEBUG [M:0;jenkins-hbase20:36165] zookeeper.ZKUtil(398): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 15:03:38,080 WARN [M:0;jenkins-hbase20:36165] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 15:03:38,080 INFO [M:0;jenkins-hbase20:36165] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 15:03:38,080 INFO [M:0;jenkins-hbase20:36165] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 15:03:38,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:38,081 DEBUG [M:0;jenkins-hbase20:36165] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:38,081 INFO [M:0;jenkins-hbase20:36165] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:38,081 DEBUG [M:0;jenkins-hbase20:36165] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:38,081 DEBUG [M:0;jenkins-hbase20:36165] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:38,081 DEBUG [M:0;jenkins-hbase20:36165] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:38,081 INFO [M:0;jenkins-hbase20:36165] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.51 KB heapSize=192.48 KB 2023-02-13 15:03:38,105 INFO [M:0;jenkins-hbase20:36165] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.51 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/93b3dd49b3494f9ba3516541d790e16b 2023-02-13 15:03:38,112 DEBUG [M:0;jenkins-hbase20:36165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/93b3dd49b3494f9ba3516541d790e16b as hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/93b3dd49b3494f9ba3516541d790e16b 2023-02-13 15:03:38,118 INFO [M:0;jenkins-hbase20:36165] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40743/user/jenkins/test-data/b9f735af-351a-2048-0695-27a7f0287ade/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/93b3dd49b3494f9ba3516541d790e16b, entries=53, sequenceid=357, filesize=10.4 K 2023-02-13 15:03:38,119 INFO [M:0;jenkins-hbase20:36165] regionserver.HRegion(2947): Finished flush of dataSize ~159.51 KB/163339, heapSize ~192.47 KB/197088, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=357, compaction requested=false 2023-02-13 15:03:38,121 INFO [M:0;jenkins-hbase20:36165] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:38,121 DEBUG [M:0;jenkins-hbase20:36165] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300618080Disabling compacts and flushes for region at 1676300618080Disabling writes for close at 1676300618081 (+1 ms)Obtaining lock to block concurrent updates at 1676300618081Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676300618081Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163339, getHeapSize=197088, getOffHeapSize=0, getCellsCount=442 at 1676300618081Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676300618085 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676300618086 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676300618089 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676300618090 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676300618113 (+23 ms)Finished flush of dataSize ~159.51 KB/163339, heapSize ~192.47 KB/197088, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=357, compaction requested=false at 1676300618119 (+6 ms)Writing region close event to WAL at 1676300618121 (+2 ms)Closed at 1676300618121 2023-02-13 15:03:38,126 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:38,126 INFO [M:0;jenkins-hbase20:36165] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 15:03:38,127 INFO [M:0;jenkins-hbase20:36165] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36165 2023-02-13 15:03:38,131 DEBUG [M:0;jenkins-hbase20:36165] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,36165,1676300603732 already deleted, retry=false 2023-02-13 15:03:38,335 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:38,335 INFO [M:0;jenkins-hbase20:36165] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,36165,1676300603732; zookeeper connection closed. 2023-02-13 15:03:38,335 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f9e5193 rejected from java.util.concurrent.ThreadPoolExecutor@37a7aa99[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 53] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,335 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): master:36165-0x1015c5d0fc00000, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:38,335 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b85b2e7 rejected from java.util.concurrent.ThreadPoolExecutor@37a7aa99[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 53] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,435 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:38,435 INFO [RS:1;jenkins-hbase20:34169] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34169,1676300604777; zookeeper connection closed. 2023-02-13 15:03:38,435 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62ca0ac4 rejected from java.util.concurrent.ThreadPoolExecutor@155ddb28[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,435 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:34169-0x1015c5d0fc00002, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:38,435 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a3a2467 rejected from java.util.concurrent.ThreadPoolExecutor@155ddb28[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,435 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d6ebe5e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d6ebe5e 2023-02-13 15:03:38,535 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:38,535 INFO [RS:0;jenkins-hbase20:32817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,32817,1676300604733; zookeeper connection closed. 2023-02-13 15:03:38,535 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c9481f5 rejected from java.util.concurrent.ThreadPoolExecutor@7b715cba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,535 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56bbd57e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56bbd57e 2023-02-13 15:03:38,535 DEBUG [Listener at localhost.localdomain/39751-EventThread] zookeeper.ZKWatcher(600): regionserver:32817-0x1015c5d0fc00001, quorum=127.0.0.1:53165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:38,536 ERROR [Listener at localhost.localdomain/39751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6566058b rejected from java.util.concurrent.ThreadPoolExecutor@7b715cba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:38,536 INFO [Listener at localhost.localdomain/39751] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 15:03:38,537 WARN [Listener at localhost.localdomain/39751] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:38,544 INFO [Listener at localhost.localdomain/39751] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:38,647 WARN [BP-1099221725-148.251.75.209-1676300600571 heartbeating to localhost.localdomain/127.0.0.1:40743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:38,648 WARN [BP-1099221725-148.251.75.209-1676300600571 heartbeating to localhost.localdomain/127.0.0.1:40743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1099221725-148.251.75.209-1676300600571 (Datanode Uuid 2f3cd2de-ad85-4444-85ac-4c7fb648da99) service to localhost.localdomain/127.0.0.1:40743 2023-02-13 15:03:38,649 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed/dfs/data/data3/current/BP-1099221725-148.251.75.209-1676300600571] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:38,650 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed/dfs/data/data4/current/BP-1099221725-148.251.75.209-1676300600571] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:38,650 WARN [Listener at localhost.localdomain/39751] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:38,653 INFO [Listener at localhost.localdomain/39751] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:38,656 WARN [BP-1099221725-148.251.75.209-1676300600571 heartbeating to localhost.localdomain/127.0.0.1:40743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:38,656 WARN [BP-1099221725-148.251.75.209-1676300600571 heartbeating to localhost.localdomain/127.0.0.1:40743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1099221725-148.251.75.209-1676300600571 (Datanode Uuid 97f85050-b3a9-4cb4-97e2-e77383b4f7a7) service to localhost.localdomain/127.0.0.1:40743 2023-02-13 15:03:38,657 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed/dfs/data/data1/current/BP-1099221725-148.251.75.209-1676300600571] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:38,657 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/cluster_102bc7af-dc49-68ef-57d7-7c85d98952ed/dfs/data/data2/current/BP-1099221725-148.251.75.209-1676300600571] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:38,686 INFO [Listener at localhost.localdomain/39751] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 15:03:38,809 INFO [Listener at localhost.localdomain/39751] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 15:03:38,880 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 15:03:38,893 INFO [Listener at localhost.localdomain/39751] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:40743 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:40743 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:40743 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,36165,1676300603732)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:40743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39751 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@2cb3eb9 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost.localdomain:40743 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:40743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:40743 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=551 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=186 (was 107) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 165), AvailableMemoryMB=7563 (was 8640) 2023-02-13 15:03:38,902 INFO [Listener at localhost.localdomain/39751] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=551, MaxFileDescriptor=60000, SystemLoadAverage=186, ProcessCount=164, AvailableMemoryMB=7563 2023-02-13 15:03:38,912 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop.log.dir so I do NOT create it in target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99 2023-02-13 15:03:38,913 WARN [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 15:03:38,913 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop.tmp.dir so I do NOT create it in target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99 2023-02-13 15:03:38,913 WARN [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d105e87-9f55-b1b0-010a-bdb5ccdaf21d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 15:03:38,913 DEBUG [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99 2023-02-13 15:03:38,913 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 15:03:38,913 INFO [Listener at localhost.localdomain/39751] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d, deleteOnExit=true 2023-02-13 15:03:38,914 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 15:03:38,914 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/test.cache.data in system properties and HBase conf 2023-02-13 15:03:38,914 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 15:03:38,914 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop.log.dir in system properties and HBase conf 2023-02-13 15:03:38,915 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 15:03:38,915 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 15:03:38,915 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 15:03:38,915 DEBUG [Listener at localhost.localdomain/39751] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 15:03:38,915 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:38,915 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:38,915 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/nfs.dump.dir in system properties and HBase conf 2023-02-13 15:03:38,916 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/java.io.tmpdir in system properties and HBase conf 2023-02-13 15:03:38,917 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:38,917 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 15:03:38,917 INFO [Listener at localhost.localdomain/39751] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 15:03:38,919 WARN [Listener at localhost.localdomain/39751] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:38,920 WARN [Listener at localhost.localdomain/39751] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:38,946 WARN [Listener at localhost.localdomain/39751] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:38,949 INFO [Listener at localhost.localdomain/39751] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:38,954 INFO [Listener at localhost.localdomain/39751] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/java.io.tmpdir/Jetty_localhost_localdomain_37429_hdfs____qpebg1/webapp 2023-02-13 15:03:39,041 INFO [Listener at localhost.localdomain/39751] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:37429 2023-02-13 15:03:39,043 WARN [Listener at localhost.localdomain/39751] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:39,043 WARN [Listener at localhost.localdomain/39751] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:39,073 WARN [Listener at localhost.localdomain/41523] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:39,084 WARN [Listener at localhost.localdomain/41523] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:39,086 WARN [Listener at localhost.localdomain/41523] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:39,087 INFO [Listener at localhost.localdomain/41523] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:39,092 INFO [Listener at localhost.localdomain/41523] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/java.io.tmpdir/Jetty_localhost_33481_datanode____.6l03ws/webapp 2023-02-13 15:03:39,182 INFO [Listener at localhost.localdomain/41523] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33481 2023-02-13 15:03:39,199 WARN [Listener at localhost.localdomain/42127] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:39,214 WARN [Listener at localhost.localdomain/42127] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:39,216 WARN [Listener at localhost.localdomain/42127] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:39,217 INFO [Listener at localhost.localdomain/42127] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:39,220 INFO [Listener at localhost.localdomain/42127] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/java.io.tmpdir/Jetty_localhost_42851_datanode____6zobjx/webapp 2023-02-13 15:03:39,280 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb316dac8ba3cdba: Processing first storage report for DS-761153d1-7c71-48b9-867d-327c2a639521 from datanode f1e2f5f7-a98c-4cd9-a715-0a27d257bf75 2023-02-13 15:03:39,280 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb316dac8ba3cdba: from storage DS-761153d1-7c71-48b9-867d-327c2a639521 node DatanodeRegistration(127.0.0.1:43587, datanodeUuid=f1e2f5f7-a98c-4cd9-a715-0a27d257bf75, infoPort=35763, infoSecurePort=0, ipcPort=42127, storageInfo=lv=-57;cid=testClusterID;nsid=788132002;c=1676300618921), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:39,280 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb316dac8ba3cdba: Processing first storage report for DS-27f3ffbc-0ffb-4a0a-ab05-76358ff9239b from datanode f1e2f5f7-a98c-4cd9-a715-0a27d257bf75 2023-02-13 15:03:39,281 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb316dac8ba3cdba: from storage DS-27f3ffbc-0ffb-4a0a-ab05-76358ff9239b node DatanodeRegistration(127.0.0.1:43587, datanodeUuid=f1e2f5f7-a98c-4cd9-a715-0a27d257bf75, infoPort=35763, infoSecurePort=0, ipcPort=42127, storageInfo=lv=-57;cid=testClusterID;nsid=788132002;c=1676300618921), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:39,321 INFO [Listener at localhost.localdomain/42127] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42851 2023-02-13 15:03:39,331 WARN [Listener at localhost.localdomain/40345] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:39,457 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6d288f6db5c593e: Processing first storage report for DS-086aa068-fc6b-4e71-b329-a2199341573a from datanode 1335cdcf-7c24-4947-a69e-545c31e6f5f5 2023-02-13 15:03:39,457 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6d288f6db5c593e: from storage DS-086aa068-fc6b-4e71-b329-a2199341573a node DatanodeRegistration(127.0.0.1:35103, datanodeUuid=1335cdcf-7c24-4947-a69e-545c31e6f5f5, infoPort=44977, infoSecurePort=0, ipcPort=40345, storageInfo=lv=-57;cid=testClusterID;nsid=788132002;c=1676300618921), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:39,457 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6d288f6db5c593e: Processing first storage report for DS-444f8a14-cb08-4f04-a82d-f6a3934d9def from datanode 1335cdcf-7c24-4947-a69e-545c31e6f5f5 2023-02-13 15:03:39,457 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6d288f6db5c593e: from storage DS-444f8a14-cb08-4f04-a82d-f6a3934d9def node DatanodeRegistration(127.0.0.1:35103, datanodeUuid=1335cdcf-7c24-4947-a69e-545c31e6f5f5, infoPort=44977, infoSecurePort=0, ipcPort=40345, storageInfo=lv=-57;cid=testClusterID;nsid=788132002;c=1676300618921), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:39,465 DEBUG [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99 2023-02-13 15:03:39,477 INFO [Listener at localhost.localdomain/40345] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d/zookeeper_0, clientPort=52423, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 15:03:39,478 INFO [Listener at localhost.localdomain/40345] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52423 2023-02-13 15:03:39,479 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,480 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,510 INFO [Listener at localhost.localdomain/40345] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a with version=8 2023-02-13 15:03:39,511 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,512 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,513 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/hbase-staging 2023-02-13 15:03:39,515 INFO [Listener at localhost.localdomain/40345] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:39,516 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,516 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,516 INFO [Listener at localhost.localdomain/40345] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:39,516 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,516 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:39,516 INFO [Listener at localhost.localdomain/40345] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:39,518 INFO [Listener at localhost.localdomain/40345] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44327 2023-02-13 15:03:39,519 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,520 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,522 INFO [Listener at localhost.localdomain/40345] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44327 connecting to ZooKeeper ensemble=127.0.0.1:52423 2023-02-13 15:03:39,611 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:443270x0, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:39,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44327-0x1015c5d50830000 connected 2023-02-13 15:03:39,681 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:39,681 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:39,682 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:39,683 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44327 2023-02-13 15:03:39,686 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44327 2023-02-13 15:03:39,687 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44327 2023-02-13 15:03:39,687 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44327 2023-02-13 15:03:39,687 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44327 2023-02-13 15:03:39,688 INFO [Listener at localhost.localdomain/40345] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a, hbase.cluster.distributed=false 2023-02-13 15:03:39,701 INFO [Listener at localhost.localdomain/40345] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:39,701 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,701 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,701 INFO [Listener at localhost.localdomain/40345] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:39,701 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,702 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:39,702 INFO [Listener at localhost.localdomain/40345] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:39,705 INFO [Listener at localhost.localdomain/40345] ipc.NettyRpcServer(120): Bind to /148.251.75.209:32935 2023-02-13 15:03:39,706 INFO [Listener at localhost.localdomain/40345] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:39,707 DEBUG [Listener at localhost.localdomain/40345] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:39,708 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,709 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,710 INFO [Listener at localhost.localdomain/40345] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32935 connecting to ZooKeeper ensemble=127.0.0.1:52423 2023-02-13 15:03:39,715 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:329350x0, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:39,716 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): regionserver:329350x0, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:39,716 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): regionserver:329350x0, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:39,717 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): regionserver:329350x0, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:39,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32935-0x1015c5d50830001 connected 2023-02-13 15:03:39,723 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32935 2023-02-13 15:03:39,723 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32935 2023-02-13 15:03:39,726 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32935 2023-02-13 15:03:39,727 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32935 2023-02-13 15:03:39,730 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32935 2023-02-13 15:03:39,750 INFO [Listener at localhost.localdomain/40345] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:39,750 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,750 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,751 INFO [Listener at localhost.localdomain/40345] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:39,751 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:39,751 INFO [Listener at localhost.localdomain/40345] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:39,751 INFO [Listener at localhost.localdomain/40345] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:39,757 INFO [Listener at localhost.localdomain/40345] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43261 2023-02-13 15:03:39,758 INFO [Listener at localhost.localdomain/40345] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:39,767 DEBUG [Listener at localhost.localdomain/40345] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:39,767 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,769 INFO [Listener at localhost.localdomain/40345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,770 INFO [Listener at localhost.localdomain/40345] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43261 connecting to ZooKeeper ensemble=127.0.0.1:52423 2023-02-13 15:03:39,777 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:432610x0, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:39,779 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): regionserver:432610x0, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:39,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43261-0x1015c5d50830002 connected 2023-02-13 15:03:39,780 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:39,781 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ZKUtil(164): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:39,787 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43261 2023-02-13 15:03:39,787 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43261 2023-02-13 15:03:39,787 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43261 2023-02-13 15:03:39,791 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43261 2023-02-13 15:03:39,791 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43261 2023-02-13 15:03:39,795 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:39,796 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:39,799 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:39,800 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:39,800 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:39,800 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:39,801 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:39,803 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:39,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44327,1676300619515 from backup master directory 2023-02-13 15:03:39,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:39,815 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:39,815 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:39,815 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:39,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:39,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/hbase.id with ID: 721b0f85-688c-4c8a-ac5c-d50466d31c3c 2023-02-13 15:03:39,852 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:39,854 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:39,867 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0a310d34 to 127.0.0.1:52423 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:39,874 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@674fdde2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:39,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:39,875 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 15:03:39,875 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:39,877 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store-tmp 2023-02-13 15:03:39,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:39,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:39,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:39,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:39,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:39,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:39,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:39,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300619890Disabling compacts and flushes for region at 1676300619890Disabling writes for close at 1676300619890Writing region close event to WAL at 1676300619890Closed at 1676300619890 2023-02-13 15:03:39,891 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/WALs/jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:39,894 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44327%2C1676300619515, suffix=, logDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/WALs/jenkins-hbase20.apache.org,44327,1676300619515, archiveDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/oldWALs, maxLogs=10 2023-02-13 15:03:39,912 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK] 2023-02-13 15:03:39,912 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK] 2023-02-13 15:03:39,915 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/WALs/jenkins-hbase20.apache.org,44327,1676300619515/jenkins-hbase20.apache.org%2C44327%2C1676300619515.1676300619894 2023-02-13 15:03:39,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK], DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK]] 2023-02-13 15:03:39,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:39,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:39,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:39,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:39,916 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:39,917 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 15:03:39,918 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 15:03:39,918 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:39,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:39,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:39,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:39,923 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:39,924 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60713575, jitterRate=-0.09529723227024078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:39,924 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676300619915Initializing all the Stores at 1676300619916 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300619916Cleaning up temporary data from old regions at 1676300619920 (+4 ms)Cleaning up detritus from prior splits at 1676300619920Region opened successfully at 1676300619924 (+4 ms) 2023-02-13 15:03:39,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 15:03:39,929 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 15:03:39,929 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 15:03:39,929 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 15:03:39,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 15:03:39,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 15:03:39,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 15:03:39,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 15:03:39,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 15:03:39,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 15:03:39,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 15:03:39,942 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 15:03:39,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 15:03:39,943 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 15:03:39,944 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:39,944 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 15:03:39,945 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 15:03:39,945 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 15:03:39,946 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:39,946 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:39,946 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:39,946 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:39,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,44327,1676300619515, sessionid=0x1015c5d50830000, setting cluster-up flag (Was=false) 2023-02-13 15:03:39,949 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:39,951 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 15:03:39,952 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:39,953 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:39,955 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 15:03:39,956 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:39,957 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.hbase-snapshot/.tmp 2023-02-13 15:03:39,958 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:39,958 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:39,958 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:39,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:39,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:39,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 15:03:39,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:39,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:39,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:39,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676300649963 2023-02-13 15:03:39,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 15:03:39,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 15:03:39,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 15:03:39,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 15:03:39,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 15:03:39,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 15:03:39,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:39,967 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:39,967 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 15:03:39,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 15:03:39,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 15:03:39,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 15:03:39,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 15:03:39,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 15:03:39,969 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:39,970 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300619968,5,FailOnTimeoutGroup] 2023-02-13 15:03:39,975 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300619975,5,FailOnTimeoutGroup] 2023-02-13 15:03:39,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:39,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 15:03:39,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:39,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:39,985 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:39,985 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:39,985 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a 2023-02-13 15:03:39,995 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(952): ClusterId : 721b0f85-688c-4c8a-ac5c-d50466d31c3c 2023-02-13 15:03:39,995 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(952): ClusterId : 721b0f85-688c-4c8a-ac5c-d50466d31c3c 2023-02-13 15:03:39,995 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:39,995 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:39,996 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:39,996 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:39,996 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:39,997 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:39,998 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:39,998 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:40,000 DEBUG [RS:0;jenkins-hbase20:32935] zookeeper.ReadOnlyZKClient(139): Connect 0x4fffee61 to 127.0.0.1:52423 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:40,000 DEBUG [RS:1;jenkins-hbase20:43261] zookeeper.ReadOnlyZKClient(139): Connect 0x78f16bde to 127.0.0.1:52423 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:40,007 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:40,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:40,015 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/info 2023-02-13 15:03:40,015 DEBUG [RS:1;jenkins-hbase20:43261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76369ab0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:40,015 DEBUG [RS:0;jenkins-hbase20:32935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@413809ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:40,015 DEBUG [RS:1;jenkins-hbase20:43261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@720900ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:40,015 DEBUG [RS:0;jenkins-hbase20:32935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45078511, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:40,015 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:40,016 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:40,016 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:40,018 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:40,018 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:40,018 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:40,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:40,020 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/table 2023-02-13 15:03:40,020 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:40,023 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:40,024 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740 2023-02-13 15:03:40,024 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740 2023-02-13 15:03:40,026 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:40,027 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:40,028 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:43261 2023-02-13 15:03:40,028 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:32935 2023-02-13 15:03:40,028 INFO [RS:1;jenkins-hbase20:43261] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:40,028 INFO [RS:1;jenkins-hbase20:43261] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:40,028 INFO [RS:0;jenkins-hbase20:32935] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:40,028 INFO [RS:0;jenkins-hbase20:32935] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:40,028 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:40,028 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:40,031 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:40,031 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44327,1676300619515 with isa=jenkins-hbase20.apache.org/148.251.75.209:43261, startcode=1676300619749 2023-02-13 15:03:40,031 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44327,1676300619515 with isa=jenkins-hbase20.apache.org/148.251.75.209:32935, startcode=1676300619701 2023-02-13 15:03:40,032 DEBUG [RS:1;jenkins-hbase20:43261] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:40,032 DEBUG [RS:0;jenkins-hbase20:32935] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:40,032 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74094417, jitterRate=0.10409285128116608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:40,032 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676300620007Initializing all the Stores at 1676300620012 (+5 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300620012Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300620013 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300620013Cleaning up temporary data from old regions at 1676300620025 (+12 ms)Cleaning up detritus from prior splits at 1676300620025Region opened successfully at 1676300620032 (+7 ms) 2023-02-13 15:03:40,032 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:40,032 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:40,032 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:40,033 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:40,033 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:40,037 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:40,038 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300620032Disabling compacts and flushes for region at 1676300620032Disabling writes for close at 1676300620033 (+1 ms)Writing region close event to WAL at 1676300620037 (+4 ms)Closed at 1676300620037 2023-02-13 15:03:40,041 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34097, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:40,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,042 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:40,043 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 15:03:40,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 15:03:40,045 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 15:03:40,045 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57495, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:40,045 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a 2023-02-13 15:03:40,046 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41523 2023-02-13 15:03:40,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,046 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:40,046 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a 2023-02-13 15:03:40,047 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41523 2023-02-13 15:03:40,047 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:40,047 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 15:03:40,047 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:40,049 DEBUG [RS:1;jenkins-hbase20:43261] zookeeper.ZKUtil(162): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,049 WARN [RS:1;jenkins-hbase20:43261] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:40,049 INFO [RS:1;jenkins-hbase20:43261] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:40,049 DEBUG [RS:0;jenkins-hbase20:32935] zookeeper.ZKUtil(162): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,050 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,050 WARN [RS:0;jenkins-hbase20:32935] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:40,050 INFO [RS:0;jenkins-hbase20:32935] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:40,050 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,059 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43261,1676300619749] 2023-02-13 15:03:40,059 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,32935,1676300619701] 2023-02-13 15:03:40,062 DEBUG [RS:0;jenkins-hbase20:32935] zookeeper.ZKUtil(162): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,062 DEBUG [RS:1;jenkins-hbase20:43261] zookeeper.ZKUtil(162): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,062 DEBUG [RS:0;jenkins-hbase20:32935] zookeeper.ZKUtil(162): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,063 DEBUG [RS:1;jenkins-hbase20:43261] zookeeper.ZKUtil(162): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,063 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:40,064 INFO [RS:0;jenkins-hbase20:32935] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:40,066 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:40,067 INFO [RS:1;jenkins-hbase20:43261] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:40,070 INFO [RS:0;jenkins-hbase20:32935] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:40,070 INFO [RS:1;jenkins-hbase20:43261] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:40,071 INFO [RS:0;jenkins-hbase20:32935] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:40,071 INFO [RS:0;jenkins-hbase20:32935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,076 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:40,076 INFO [RS:1;jenkins-hbase20:43261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:40,077 INFO [RS:1;jenkins-hbase20:43261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,078 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:40,079 INFO [RS:0;jenkins-hbase20:32935] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,079 INFO [RS:1;jenkins-hbase20:43261] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,079 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,080 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,081 DEBUG [RS:0;jenkins-hbase20:32935] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,081 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,081 DEBUG [RS:1;jenkins-hbase20:43261] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:40,091 INFO [RS:0;jenkins-hbase20:32935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,091 INFO [RS:0;jenkins-hbase20:32935] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,091 INFO [RS:0;jenkins-hbase20:32935] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,093 INFO [RS:1;jenkins-hbase20:43261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,094 INFO [RS:1;jenkins-hbase20:43261] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,094 INFO [RS:1;jenkins-hbase20:43261] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,103 INFO [RS:0;jenkins-hbase20:32935] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:40,103 INFO [RS:0;jenkins-hbase20:32935] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32935,1676300619701-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,107 INFO [RS:1;jenkins-hbase20:43261] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:40,107 INFO [RS:1;jenkins-hbase20:43261] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43261,1676300619749-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,116 INFO [RS:0;jenkins-hbase20:32935] regionserver.Replication(203): jenkins-hbase20.apache.org,32935,1676300619701 started 2023-02-13 15:03:40,116 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,32935,1676300619701, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:32935, sessionid=0x1015c5d50830001 2023-02-13 15:03:40,116 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:40,116 DEBUG [RS:0;jenkins-hbase20:32935] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,116 DEBUG [RS:0;jenkins-hbase20:32935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32935,1676300619701' 2023-02-13 15:03:40,116 DEBUG [RS:0;jenkins-hbase20:32935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:40,117 DEBUG [RS:0;jenkins-hbase20:32935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:40,117 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:40,117 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:40,117 DEBUG [RS:0;jenkins-hbase20:32935] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,117 DEBUG [RS:0;jenkins-hbase20:32935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32935,1676300619701' 2023-02-13 15:03:40,117 DEBUG [RS:0;jenkins-hbase20:32935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:40,118 DEBUG [RS:0;jenkins-hbase20:32935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:40,118 DEBUG [RS:0;jenkins-hbase20:32935] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:40,118 INFO [RS:0;jenkins-hbase20:32935] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:40,118 INFO [RS:0;jenkins-hbase20:32935] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:40,126 INFO [RS:1;jenkins-hbase20:43261] regionserver.Replication(203): jenkins-hbase20.apache.org,43261,1676300619749 started 2023-02-13 15:03:40,126 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,43261,1676300619749, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43261, sessionid=0x1015c5d50830002 2023-02-13 15:03:40,126 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:40,126 DEBUG [RS:1;jenkins-hbase20:43261] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,126 DEBUG [RS:1;jenkins-hbase20:43261] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43261,1676300619749' 2023-02-13 15:03:40,126 DEBUG [RS:1;jenkins-hbase20:43261] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:40,127 DEBUG [RS:1;jenkins-hbase20:43261] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:40,127 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:40,127 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:40,127 DEBUG [RS:1;jenkins-hbase20:43261] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,127 DEBUG [RS:1;jenkins-hbase20:43261] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43261,1676300619749' 2023-02-13 15:03:40,127 DEBUG [RS:1;jenkins-hbase20:43261] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:40,127 DEBUG [RS:1;jenkins-hbase20:43261] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:40,128 DEBUG [RS:1;jenkins-hbase20:43261] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:40,128 INFO [RS:1;jenkins-hbase20:43261] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:40,128 INFO [RS:1;jenkins-hbase20:43261] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:40,197 DEBUG [jenkins-hbase20:44327] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 15:03:40,197 DEBUG [jenkins-hbase20:44327] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:40,200 DEBUG [jenkins-hbase20:44327] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:40,200 DEBUG [jenkins-hbase20:44327] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:40,200 DEBUG [jenkins-hbase20:44327] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:40,201 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43261,1676300619749, state=OPENING 2023-02-13 15:03:40,202 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 15:03:40,202 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:40,203 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:40,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43261,1676300619749}] 2023-02-13 15:03:40,357 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:40,358 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:40,360 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:40,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 15:03:40,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:40,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43261%2C1676300619749.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,43261,1676300619749, archiveDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/oldWALs, maxLogs=32 2023-02-13 15:03:40,383 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK] 2023-02-13 15:03:40,383 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK] 2023-02-13 15:03:40,386 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,43261,1676300619749/jenkins-hbase20.apache.org%2C43261%2C1676300619749.meta.1676300620369.meta 2023-02-13 15:03:40,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK], DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK]] 2023-02-13 15:03:40,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:40,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 15:03:40,387 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 15:03:40,388 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 15:03:40,388 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 15:03:40,388 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:40,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 15:03:40,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 15:03:40,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:40,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/info 2023-02-13 15:03:40,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/info 2023-02-13 15:03:40,392 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:40,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:40,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:40,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:40,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:40,394 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:40,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:40,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:40,396 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/table 2023-02-13 15:03:40,396 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/table 2023-02-13 15:03:40,397 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:40,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:40,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740 2023-02-13 15:03:40,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740 2023-02-13 15:03:40,402 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:40,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:40,452 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59347656, jitterRate=-0.11565101146697998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:40,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676300620389Writing region info on filesystem at 1676300620389Initializing all the Stores at 1676300620390 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300620390Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300620390Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300620390Cleaning up temporary data from old regions at 1676300620401 (+11 ms)Cleaning up detritus from prior splits at 1676300620401Running coprocessor post-open hooks at 1676300620452 (+51 ms)Region opened successfully at 1676300620452 2023-02-13 15:03:40,453 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676300620357 2023-02-13 15:03:40,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 15:03:40,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 15:03:40,460 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43261,1676300619749, state=OPEN 2023-02-13 15:03:40,461 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 15:03:40,461 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:40,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 15:03:40,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43261,1676300619749 in 258 msec 2023-02-13 15:03:40,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 15:03:40,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 421 msec 2023-02-13 15:03:40,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 509 msec 2023-02-13 15:03:40,468 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676300619799, completionTime=-1 2023-02-13 15:03:40,468 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 15:03:40,468 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 15:03:40,472 DEBUG [hconnection-0x5d8fa7c8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:40,474 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51366, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:40,476 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 15:03:40,476 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676300680476 2023-02-13 15:03:40,477 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676300740477 2023-02-13 15:03:40,477 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-13 15:03:40,482 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44327,1676300619515-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44327,1676300619515-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44327,1676300619515-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44327, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:40,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 15:03:40,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:40,484 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 15:03:40,485 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 15:03:40,486 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:40,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:40,489 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,489 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1 empty. 2023-02-13 15:03:40,490 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,490 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 15:03:40,501 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:40,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e18c304667822681dc9348fd5e92d4c1, NAME => 'hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:40,511 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:40,511 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e18c304667822681dc9348fd5e92d4c1, disabling compactions & flushes 2023-02-13 15:03:40,511 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:40,511 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:40,511 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. after waiting 0 ms 2023-02-13 15:03:40,511 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:40,511 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:40,511 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e18c304667822681dc9348fd5e92d4c1: Waiting for close lock at 1676300620511Disabling compacts and flushes for region at 1676300620511Disabling writes for close at 1676300620511Writing region close event to WAL at 1676300620511Closed at 1676300620511 2023-02-13 15:03:40,514 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:40,515 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300620515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300620515"}]},"ts":"1676300620515"} 2023-02-13 15:03:40,519 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:03:40,520 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:40,520 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300620520"}]},"ts":"1676300620520"} 2023-02-13 15:03:40,522 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 15:03:40,525 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:40,525 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:40,526 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:40,526 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:40,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e18c304667822681dc9348fd5e92d4c1, ASSIGN}] 2023-02-13 15:03:40,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e18c304667822681dc9348fd5e92d4c1, ASSIGN 2023-02-13 15:03:40,530 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e18c304667822681dc9348fd5e92d4c1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32935,1676300619701; forceNewPlan=false, retain=false 2023-02-13 15:03:40,680 INFO [jenkins-hbase20:44327] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:03:40,681 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e18c304667822681dc9348fd5e92d4c1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,681 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300620681"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300620681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300620681"}]},"ts":"1676300620681"} 2023-02-13 15:03:40,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e18c304667822681dc9348fd5e92d4c1, server=jenkins-hbase20.apache.org,32935,1676300619701}] 2023-02-13 15:03:40,836 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,836 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:40,839 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:40,843 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:40,845 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C32935%2C1676300619701, suffix=, logDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,32935,1676300619701, archiveDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/oldWALs, maxLogs=32 2023-02-13 15:03:40,861 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK] 2023-02-13 15:03:40,861 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK] 2023-02-13 15:03:40,863 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,32935,1676300619701/jenkins-hbase20.apache.org%2C32935%2C1676300619701.1676300620846 2023-02-13 15:03:40,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK], DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK]] 2023-02-13 15:03:40,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e18c304667822681dc9348fd5e92d4c1, NAME => 'hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:40,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:40,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,865 INFO [StoreOpener-e18c304667822681dc9348fd5e92d4c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,867 DEBUG [StoreOpener-e18c304667822681dc9348fd5e92d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/info 2023-02-13 15:03:40,867 DEBUG [StoreOpener-e18c304667822681dc9348fd5e92d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/info 2023-02-13 15:03:40,867 INFO [StoreOpener-e18c304667822681dc9348fd5e92d4c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e18c304667822681dc9348fd5e92d4c1 columnFamilyName info 2023-02-13 15:03:40,868 INFO [StoreOpener-e18c304667822681dc9348fd5e92d4c1-1] regionserver.HStore(310): Store=e18c304667822681dc9348fd5e92d4c1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:40,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:40,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:40,874 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e18c304667822681dc9348fd5e92d4c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61927461, jitterRate=-0.07720892131328583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:40,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e18c304667822681dc9348fd5e92d4c1: Running coprocessor pre-open hook at 1676300620864Writing region info on filesystem at 1676300620864Initializing all the Stores at 1676300620865 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300620865Cleaning up temporary data from old regions at 1676300620869 (+4 ms)Cleaning up detritus from prior splits at 1676300620870 (+1 ms)Running coprocessor post-open hooks at 1676300620874 (+4 ms)Region opened successfully at 1676300620874 2023-02-13 15:03:40,875 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1., pid=6, masterSystemTime=1676300620836 2023-02-13 15:03:40,878 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:40,879 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:40,879 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e18c304667822681dc9348fd5e92d4c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:40,879 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300620879"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300620879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300620879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300620879"}]},"ts":"1676300620879"} 2023-02-13 15:03:40,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 15:03:40,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e18c304667822681dc9348fd5e92d4c1, server=jenkins-hbase20.apache.org,32935,1676300619701 in 198 msec 2023-02-13 15:03:40,885 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 15:03:40,885 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e18c304667822681dc9348fd5e92d4c1, ASSIGN in 357 msec 2023-02-13 15:03:40,886 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:40,886 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300620886"}]},"ts":"1676300620886"} 2023-02-13 15:03:40,888 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 15:03:40,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:40,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 407 msec 2023-02-13 15:03:40,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 15:03:40,987 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:40,987 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:40,989 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:40,992 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56742, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:40,994 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 15:03:41,004 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:41,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-13 15:03:41,017 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 15:03:41,024 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:41,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 15:03:41,030 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 15:03:41,032 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 15:03:41,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.217sec 2023-02-13 15:03:41,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 15:03:41,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 15:03:41,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 15:03:41,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44327,1676300619515-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 15:03:41,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44327,1676300619515-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 15:03:41,034 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 15:03:41,096 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ReadOnlyZKClient(139): Connect 0x030f4123 to 127.0.0.1:52423 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:41,100 DEBUG [Listener at localhost.localdomain/40345] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e9fab8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:41,102 DEBUG [hconnection-0x7473d711-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:41,104 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:41,105 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:41,106 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 15:03:41,108 DEBUG [Listener at localhost.localdomain/40345] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 15:03:41,110 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57346, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 15:03:41,111 INFO [Listener at localhost.localdomain/40345] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 15:03:41,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-13 15:03:41,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:03:41,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 148.251.75.209:57346 deadline: 1676300681112, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 15:03:41,112 INFO [Listener at localhost.localdomain/40345] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 15:03:41,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:41,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 15:03:41,119 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:41,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 15:03:41,120 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:41,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,130 INFO [RS:1;jenkins-hbase20:43261] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43261%2C1676300619749, suffix=, logDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,43261,1676300619749, archiveDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/oldWALs, maxLogs=32 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32 empty. 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f empty. 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,130 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b empty. 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a empty. 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a empty. 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03 empty. 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14 empty. 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f empty. 2023-02-13 15:03:41,132 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,132 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f empty. 2023-02-13 15:03:41,132 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,132 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,132 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc empty. 2023-02-13 15:03:41,132 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,132 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,132 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 15:03:41,152 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:41,155 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK] 2023-02-13 15:03:41,155 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK] 2023-02-13 15:03:41,156 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3e7b613215d42c7bacf205bef8677c14, NAME => 'testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,157 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1cf110e0ba97a96edb7093e36a32c37f, NAME => 'testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,157 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => fc2a1fd673f2e19effb20f01b21bea03, NAME => 'testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,157 INFO [RS:1;jenkins-hbase20:43261] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/WALs/jenkins-hbase20.apache.org,43261,1676300619749/jenkins-hbase20.apache.org%2C43261%2C1676300619749.1676300621131 2023-02-13 15:03:41,158 DEBUG [RS:1;jenkins-hbase20:43261] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK], DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK]] 2023-02-13 15:03:41,173 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,173 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3e7b613215d42c7bacf205bef8677c14, disabling compactions & flushes 2023-02-13 15:03:41,173 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:41,173 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:41,173 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. after waiting 0 ms 2023-02-13 15:03:41,173 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:41,173 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:41,173 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3e7b613215d42c7bacf205bef8677c14: Waiting for close lock at 1676300621173Disabling compacts and flushes for region at 1676300621173Disabling writes for close at 1676300621173Writing region close event to WAL at 1676300621173Closed at 1676300621173 2023-02-13 15:03:41,174 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5929cc1c7b5c57368512e5d14cd0ee1a, NAME => 'testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing fc2a1fd673f2e19effb20f01b21bea03, disabling compactions & flushes 2023-02-13 15:03:41,176 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:41,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:41,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. after waiting 0 ms 2023-02-13 15:03:41,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:41,176 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:41,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for fc2a1fd673f2e19effb20f01b21bea03: Waiting for close lock at 1676300621176Disabling compacts and flushes for region at 1676300621176Disabling writes for close at 1676300621176Writing region close event to WAL at 1676300621176Closed at 1676300621176 2023-02-13 15:03:41,177 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1e288a4f22940d235d1c3d5680634f32, NAME => 'testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,187 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,187 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 5929cc1c7b5c57368512e5d14cd0ee1a, disabling compactions & flushes 2023-02-13 15:03:41,187 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:41,187 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:41,187 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. after waiting 0 ms 2023-02-13 15:03:41,187 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:41,187 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:41,187 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 5929cc1c7b5c57368512e5d14cd0ee1a: Waiting for close lock at 1676300621187Disabling compacts and flushes for region at 1676300621187Disabling writes for close at 1676300621187Writing region close event to WAL at 1676300621187Closed at 1676300621187 2023-02-13 15:03:41,188 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 23b3c280fb8fa33685d17b7e59c9c23b, NAME => 'testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,193 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,193 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 1e288a4f22940d235d1c3d5680634f32, disabling compactions & flushes 2023-02-13 15:03:41,193 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:41,193 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:41,193 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. after waiting 0 ms 2023-02-13 15:03:41,193 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:41,193 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:41,193 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 1e288a4f22940d235d1c3d5680634f32: Waiting for close lock at 1676300621193Disabling compacts and flushes for region at 1676300621193Disabling writes for close at 1676300621193Writing region close event to WAL at 1676300621193Closed at 1676300621193 2023-02-13 15:03:41,194 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 81790214badbeb2b84fbf777b424492a, NAME => 'testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,199 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,199 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 23b3c280fb8fa33685d17b7e59c9c23b, disabling compactions & flushes 2023-02-13 15:03:41,199 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:41,199 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:41,199 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. after waiting 0 ms 2023-02-13 15:03:41,199 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:41,199 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:41,199 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 23b3c280fb8fa33685d17b7e59c9c23b: Waiting for close lock at 1676300621199Disabling compacts and flushes for region at 1676300621199Disabling writes for close at 1676300621199Writing region close event to WAL at 1676300621199Closed at 1676300621199 2023-02-13 15:03:41,200 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 896400298655c8a2b00fed5bcd208f1f, NAME => 'testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 81790214badbeb2b84fbf777b424492a, disabling compactions & flushes 2023-02-13 15:03:41,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:41,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:41,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. after waiting 0 ms 2023-02-13 15:03:41,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:41,207 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:41,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 81790214badbeb2b84fbf777b424492a: Waiting for close lock at 1676300621206Disabling compacts and flushes for region at 1676300621206Disabling writes for close at 1676300621206Writing region close event to WAL at 1676300621207 (+1 ms)Closed at 1676300621207 2023-02-13 15:03:41,207 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 075e7e62d8986f2db8d4bf14e7f49cdc, NAME => 'testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,209 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,209 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 896400298655c8a2b00fed5bcd208f1f, disabling compactions & flushes 2023-02-13 15:03:41,209 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:41,209 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:41,209 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. after waiting 0 ms 2023-02-13 15:03:41,209 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:41,209 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:41,209 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 896400298655c8a2b00fed5bcd208f1f: Waiting for close lock at 1676300621209Disabling compacts and flushes for region at 1676300621209Disabling writes for close at 1676300621209Writing region close event to WAL at 1676300621209Closed at 1676300621209 2023-02-13 15:03:41,210 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => aa676702bcb180694d8939267a94293f, NAME => 'testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.tmp 2023-02-13 15:03:41,215 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,215 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 075e7e62d8986f2db8d4bf14e7f49cdc, disabling compactions & flushes 2023-02-13 15:03:41,215 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:41,215 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:41,215 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. after waiting 0 ms 2023-02-13 15:03:41,215 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:41,215 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:41,215 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 075e7e62d8986f2db8d4bf14e7f49cdc: Waiting for close lock at 1676300621215Disabling compacts and flushes for region at 1676300621215Disabling writes for close at 1676300621215Writing region close event to WAL at 1676300621215Closed at 1676300621215 2023-02-13 15:03:41,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing aa676702bcb180694d8939267a94293f, disabling compactions & flushes 2023-02-13 15:03:41,216 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:41,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:41,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. after waiting 0 ms 2023-02-13 15:03:41,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:41,216 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:41,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for aa676702bcb180694d8939267a94293f: Waiting for close lock at 1676300621216Disabling compacts and flushes for region at 1676300621216Disabling writes for close at 1676300621216Writing region close event to WAL at 1676300621216Closed at 1676300621216 2023-02-13 15:03:41,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:41,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:41,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1cf110e0ba97a96edb7093e36a32c37f, disabling compactions & flushes 2023-02-13 15:03:41,573 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:41,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:41,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. after waiting 0 ms 2023-02-13 15:03:41,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:41,573 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:41,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1cf110e0ba97a96edb7093e36a32c37f: Waiting for close lock at 1676300621573Disabling compacts and flushes for region at 1676300621573Disabling writes for close at 1676300621573Writing region close event to WAL at 1676300621573Closed at 1676300621573 2023-02-13 15:03:41,576 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676300621114.81790214badbeb2b84fbf777b424492a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300621578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300621578"}]},"ts":"1676300621578"} 2023-02-13 15:03:41,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 15:03:41,583 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:41,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300621583"}]},"ts":"1676300621583"} 2023-02-13 15:03:41,585 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 15:03:41,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:41,595 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:41,595 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:41,595 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:41,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1cf110e0ba97a96edb7093e36a32c37f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc2a1fd673f2e19effb20f01b21bea03, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e7b613215d42c7bacf205bef8677c14, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5929cc1c7b5c57368512e5d14cd0ee1a, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1e288a4f22940d235d1c3d5680634f32, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=23b3c280fb8fa33685d17b7e59c9c23b, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81790214badbeb2b84fbf777b424492a, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=896400298655c8a2b00fed5bcd208f1f, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=075e7e62d8986f2db8d4bf14e7f49cdc, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aa676702bcb180694d8939267a94293f, ASSIGN}] 2023-02-13 15:03:41,598 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81790214badbeb2b84fbf777b424492a, ASSIGN 2023-02-13 15:03:41,598 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1e288a4f22940d235d1c3d5680634f32, ASSIGN 2023-02-13 15:03:41,598 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=23b3c280fb8fa33685d17b7e59c9c23b, ASSIGN 2023-02-13 15:03:41,598 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5929cc1c7b5c57368512e5d14cd0ee1a, ASSIGN 2023-02-13 15:03:41,599 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=81790214badbeb2b84fbf777b424492a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32935,1676300619701; forceNewPlan=false, retain=false 2023-02-13 15:03:41,599 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=23b3c280fb8fa33685d17b7e59c9c23b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43261,1676300619749; forceNewPlan=false, retain=false 2023-02-13 15:03:41,599 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1e288a4f22940d235d1c3d5680634f32, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32935,1676300619701; forceNewPlan=false, retain=false 2023-02-13 15:03:41,599 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5929cc1c7b5c57368512e5d14cd0ee1a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43261,1676300619749; forceNewPlan=false, retain=false 2023-02-13 15:03:41,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aa676702bcb180694d8939267a94293f, ASSIGN 2023-02-13 15:03:41,600 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=075e7e62d8986f2db8d4bf14e7f49cdc, ASSIGN 2023-02-13 15:03:41,600 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e7b613215d42c7bacf205bef8677c14, ASSIGN 2023-02-13 15:03:41,601 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=896400298655c8a2b00fed5bcd208f1f, ASSIGN 2023-02-13 15:03:41,601 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc2a1fd673f2e19effb20f01b21bea03, ASSIGN 2023-02-13 15:03:41,601 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=aa676702bcb180694d8939267a94293f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43261,1676300619749; forceNewPlan=false, retain=false 2023-02-13 15:03:41,601 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=075e7e62d8986f2db8d4bf14e7f49cdc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32935,1676300619701; forceNewPlan=false, retain=false 2023-02-13 15:03:41,601 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3e7b613215d42c7bacf205bef8677c14, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43261,1676300619749; forceNewPlan=false, retain=false 2023-02-13 15:03:41,601 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=896400298655c8a2b00fed5bcd208f1f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43261,1676300619749; forceNewPlan=false, retain=false 2023-02-13 15:03:41,602 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fc2a1fd673f2e19effb20f01b21bea03, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32935,1676300619701; forceNewPlan=false, retain=false 2023-02-13 15:03:41,602 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1cf110e0ba97a96edb7093e36a32c37f, ASSIGN 2023-02-13 15:03:41,603 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1cf110e0ba97a96edb7093e36a32c37f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32935,1676300619701; forceNewPlan=false, retain=false 2023-02-13 15:03:41,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:41,749 INFO [jenkins-hbase20:44327] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 15:03:41,753 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=23b3c280fb8fa33685d17b7e59c9c23b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,753 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5929cc1c7b5c57368512e5d14cd0ee1a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,753 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=896400298655c8a2b00fed5bcd208f1f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,753 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3e7b613215d42c7bacf205bef8677c14, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,753 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621753"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621753"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621753"}]},"ts":"1676300621753"} 2023-02-13 15:03:41,753 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621753"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621753"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621753"}]},"ts":"1676300621753"} 2023-02-13 15:03:41,753 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aa676702bcb180694d8939267a94293f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,753 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621753"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621753"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621753"}]},"ts":"1676300621753"} 2023-02-13 15:03:41,753 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621753"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621753"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621753"}]},"ts":"1676300621753"} 2023-02-13 15:03:41,753 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300621753"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621753"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621753"}]},"ts":"1676300621753"} 2023-02-13 15:03:41,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 5929cc1c7b5c57368512e5d14cd0ee1a, server=jenkins-hbase20.apache.org,43261,1676300619749}] 2023-02-13 15:03:41,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 3e7b613215d42c7bacf205bef8677c14, server=jenkins-hbase20.apache.org,43261,1676300619749}] 2023-02-13 15:03:41,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure 896400298655c8a2b00fed5bcd208f1f, server=jenkins-hbase20.apache.org,43261,1676300619749}] 2023-02-13 15:03:41,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 23b3c280fb8fa33685d17b7e59c9c23b, server=jenkins-hbase20.apache.org,43261,1676300619749}] 2023-02-13 15:03:41,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure aa676702bcb180694d8939267a94293f, server=jenkins-hbase20.apache.org,43261,1676300619749}] 2023-02-13 15:03:41,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1cf110e0ba97a96edb7093e36a32c37f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,762 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300621761"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621761"}]},"ts":"1676300621761"} 2023-02-13 15:03:41,763 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=075e7e62d8986f2db8d4bf14e7f49cdc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,763 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621763"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621763"}]},"ts":"1676300621763"} 2023-02-13 15:03:41,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fc2a1fd673f2e19effb20f01b21bea03, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,765 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=81790214badbeb2b84fbf777b424492a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621764"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621764"}]},"ts":"1676300621764"} 2023-02-13 15:03:41,765 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676300621114.81790214badbeb2b84fbf777b424492a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621765"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621765"}]},"ts":"1676300621765"} 2023-02-13 15:03:41,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure 1cf110e0ba97a96edb7093e36a32c37f, server=jenkins-hbase20.apache.org,32935,1676300619701}] 2023-02-13 15:03:41,768 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1e288a4f22940d235d1c3d5680634f32, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure 075e7e62d8986f2db8d4bf14e7f49cdc, server=jenkins-hbase20.apache.org,32935,1676300619701}] 2023-02-13 15:03:41,768 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621767"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300621767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300621767"}]},"ts":"1676300621767"} 2023-02-13 15:03:41,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure fc2a1fd673f2e19effb20f01b21bea03, server=jenkins-hbase20.apache.org,32935,1676300619701}] 2023-02-13 15:03:41,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure 81790214badbeb2b84fbf777b424492a, server=jenkins-hbase20.apache.org,32935,1676300619701}] 2023-02-13 15:03:41,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 1e288a4f22940d235d1c3d5680634f32, server=jenkins-hbase20.apache.org,32935,1676300619701}] 2023-02-13 15:03:41,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:41,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5929cc1c7b5c57368512e5d14cd0ee1a, NAME => 'testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 15:03:41,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,913 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,915 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1 2023-02-13 15:03:41,915 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1 2023-02-13 15:03:41,915 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5929cc1c7b5c57368512e5d14cd0ee1a columnFamilyName f1 2023-02-13 15:03:41,916 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(310): Store=5929cc1c7b5c57368512e5d14cd0ee1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,916 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,918 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2 2023-02-13 15:03:41,918 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2 2023-02-13 15:03:41,918 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5929cc1c7b5c57368512e5d14cd0ee1a columnFamilyName f2 2023-02-13 15:03:41,918 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(310): Store=5929cc1c7b5c57368512e5d14cd0ee1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:41,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:41,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fc2a1fd673f2e19effb20f01b21bea03, NAME => 'testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 15:03:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5929cc1c7b5c57368512e5d14cd0ee1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59234242, jitterRate=-0.11734101176261902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:41,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5929cc1c7b5c57368512e5d14cd0ee1a: Running coprocessor pre-open hook at 1676300621912Writing region info on filesystem at 1676300621912Initializing all the Stores at 1676300621913 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621913Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621913Cleaning up temporary data from old regions at 1676300621921 (+8 ms)Cleaning up detritus from prior splits at 1676300621921Running coprocessor post-open hooks at 1676300621927 (+6 ms)Region opened successfully at 1676300621927 2023-02-13 15:03:41,928 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a., pid=21, masterSystemTime=1676300621908 2023-02-13 15:03:41,929 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1 2023-02-13 15:03:41,929 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1 2023-02-13 15:03:41,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:41,930 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc2a1fd673f2e19effb20f01b21bea03 columnFamilyName f1 2023-02-13 15:03:41,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:41,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:41,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3e7b613215d42c7bacf205bef8677c14, NAME => 'testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 15:03:41,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5929cc1c7b5c57368512e5d14cd0ee1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,930 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621930"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300621930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300621930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300621930"}]},"ts":"1676300621930"} 2023-02-13 15:03:41,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,931 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(310): Store=fc2a1fd673f2e19effb20f01b21bea03/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,931 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,932 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,932 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2 2023-02-13 15:03:41,932 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2 2023-02-13 15:03:41,933 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc2a1fd673f2e19effb20f01b21bea03 columnFamilyName f2 2023-02-13 15:03:41,933 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1 2023-02-13 15:03:41,933 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1 2023-02-13 15:03:41,933 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(310): Store=fc2a1fd673f2e19effb20f01b21bea03/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,933 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e7b613215d42c7bacf205bef8677c14 columnFamilyName f1 2023-02-13 15:03:41,934 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(310): Store=3e7b613215d42c7bacf205bef8677c14/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,934 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,935 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2 2023-02-13 15:03:41,935 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2 2023-02-13 15:03:41,936 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e7b613215d42c7bacf205bef8677c14 columnFamilyName f2 2023-02-13 15:03:41,936 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(310): Store=3e7b613215d42c7bacf205bef8677c14/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-13 15:03:41,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 5929cc1c7b5c57368512e5d14cd0ee1a, server=jenkins-hbase20.apache.org,43261,1676300619749 in 180 msec 2023-02-13 15:03:41,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5929cc1c7b5c57368512e5d14cd0ee1a, ASSIGN in 342 msec 2023-02-13 15:03:41,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:41,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:41,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:41,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:41,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:41,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 3e7b613215d42c7bacf205bef8677c14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71682018, jitterRate=0.06814530491828918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:41,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 3e7b613215d42c7bacf205bef8677c14: Running coprocessor pre-open hook at 1676300621931Writing region info on filesystem at 1676300621931Initializing all the Stores at 1676300621931Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621931Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621932 (+1 ms)Cleaning up temporary data from old regions at 1676300621938 (+6 ms)Cleaning up detritus from prior splits at 1676300621938Running coprocessor post-open hooks at 1676300621943 (+5 ms)Region opened successfully at 1676300621943 2023-02-13 15:03:41,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14., pid=22, masterSystemTime=1676300621908 2023-02-13 15:03:41,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:41,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened fc2a1fd673f2e19effb20f01b21bea03; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69104016, jitterRate=0.02973008155822754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:41,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for fc2a1fd673f2e19effb20f01b21bea03: Running coprocessor pre-open hook at 1676300621927Writing region info on filesystem at 1676300621927Initializing all the Stores at 1676300621927Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621927Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621928 (+1 ms)Cleaning up temporary data from old regions at 1676300621935 (+7 ms)Cleaning up detritus from prior splits at 1676300621941 (+6 ms)Running coprocessor post-open hooks at 1676300621946 (+5 ms)Region opened successfully at 1676300621946 2023-02-13 15:03:41,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:41,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:41,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:41,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 896400298655c8a2b00fed5bcd208f1f, NAME => 'testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 15:03:41,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03., pid=28, masterSystemTime=1676300621921 2023-02-13 15:03:41,946 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3e7b613215d42c7bacf205bef8677c14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,947 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621946"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300621946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300621946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300621946"}]},"ts":"1676300621946"} 2023-02-13 15:03:41,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:41,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:41,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:41,948 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 075e7e62d8986f2db8d4bf14e7f49cdc, NAME => 'testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 15:03:41,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fc2a1fd673f2e19effb20f01b21bea03, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621948"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300621948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300621948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300621948"}]},"ts":"1676300621948"} 2023-02-13 15:03:41,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-13 15:03:41,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 3e7b613215d42c7bacf205bef8677c14, server=jenkins-hbase20.apache.org,43261,1676300619749 in 192 msec 2023-02-13 15:03:41,950 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,950 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1 2023-02-13 15:03:41,950 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1 2023-02-13 15:03:41,951 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 896400298655c8a2b00fed5bcd208f1f columnFamilyName f1 2023-02-13 15:03:41,953 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(310): Store=896400298655c8a2b00fed5bcd208f1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,953 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,953 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1 2023-02-13 15:03:41,953 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1 2023-02-13 15:03:41,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3e7b613215d42c7bacf205bef8677c14, ASSIGN in 355 msec 2023-02-13 15:03:41,954 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 075e7e62d8986f2db8d4bf14e7f49cdc columnFamilyName f1 2023-02-13 15:03:41,954 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(310): Store=075e7e62d8986f2db8d4bf14e7f49cdc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,954 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2 2023-02-13 15:03:41,954 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,954 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2 2023-02-13 15:03:41,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-13 15:03:41,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure fc2a1fd673f2e19effb20f01b21bea03, server=jenkins-hbase20.apache.org,32935,1676300619701 in 181 msec 2023-02-13 15:03:41,955 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 896400298655c8a2b00fed5bcd208f1f columnFamilyName f2 2023-02-13 15:03:41,955 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(310): Store=896400298655c8a2b00fed5bcd208f1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,956 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2 2023-02-13 15:03:41,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc2a1fd673f2e19effb20f01b21bea03, ASSIGN in 360 msec 2023-02-13 15:03:41,956 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2 2023-02-13 15:03:41,956 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 075e7e62d8986f2db8d4bf14e7f49cdc columnFamilyName f2 2023-02-13 15:03:41,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,957 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(310): Store=075e7e62d8986f2db8d4bf14e7f49cdc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:41,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:41,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:41,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:41,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:41,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 896400298655c8a2b00fed5bcd208f1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70743688, jitterRate=0.05416309833526611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:41,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 896400298655c8a2b00fed5bcd208f1f: Running coprocessor pre-open hook at 1676300621947Writing region info on filesystem at 1676300621947Initializing all the Stores at 1676300621948 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621948Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621948Cleaning up temporary data from old regions at 1676300621957 (+9 ms)Cleaning up detritus from prior splits at 1676300621958 (+1 ms)Running coprocessor post-open hooks at 1676300621962 (+4 ms)Region opened successfully at 1676300621962 2023-02-13 15:03:41,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:41,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f., pid=23, masterSystemTime=1676300621908 2023-02-13 15:03:41,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 075e7e62d8986f2db8d4bf14e7f49cdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60880716, jitterRate=-0.09280663728713989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:41,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 075e7e62d8986f2db8d4bf14e7f49cdc: Running coprocessor pre-open hook at 1676300621949Writing region info on filesystem at 1676300621949Initializing all the Stores at 1676300621950 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621950Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621950Cleaning up temporary data from old regions at 1676300621959 (+9 ms)Cleaning up detritus from prior splits at 1676300621959Running coprocessor post-open hooks at 1676300621963 (+4 ms)Region opened successfully at 1676300621963 2023-02-13 15:03:41,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc., pid=27, masterSystemTime=1676300621921 2023-02-13 15:03:41,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:41,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:41,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:41,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 23b3c280fb8fa33685d17b7e59c9c23b, NAME => 'testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 15:03:41,965 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=896400298655c8a2b00fed5bcd208f1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,965 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621965"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300621965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300621965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300621965"}]},"ts":"1676300621965"} 2023-02-13 15:03:41,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:41,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:41,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:41,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1e288a4f22940d235d1c3d5680634f32, NAME => 'testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 15:03:41,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,969 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=075e7e62d8986f2db8d4bf14e7f49cdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,969 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621969"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300621969"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300621969"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300621969"}]},"ts":"1676300621969"} 2023-02-13 15:03:41,969 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,969 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-13 15:03:41,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure 896400298655c8a2b00fed5bcd208f1f, server=jenkins-hbase20.apache.org,43261,1676300619749 in 212 msec 2023-02-13 15:03:41,971 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1 2023-02-13 15:03:41,971 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1 2023-02-13 15:03:41,971 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1 2023-02-13 15:03:41,972 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1 2023-02-13 15:03:41,972 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e288a4f22940d235d1c3d5680634f32 columnFamilyName f1 2023-02-13 15:03:41,972 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23b3c280fb8fa33685d17b7e59c9c23b columnFamilyName f1 2023-02-13 15:03:41,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=896400298655c8a2b00fed5bcd208f1f, ASSIGN in 376 msec 2023-02-13 15:03:41,973 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(310): Store=1e288a4f22940d235d1c3d5680634f32/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,973 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(310): Store=23b3c280fb8fa33685d17b7e59c9c23b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-13 15:03:41,973 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure 075e7e62d8986f2db8d4bf14e7f49cdc, server=jenkins-hbase20.apache.org,32935,1676300619701 in 203 msec 2023-02-13 15:03:41,973 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,974 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2 2023-02-13 15:03:41,974 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2 2023-02-13 15:03:41,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=075e7e62d8986f2db8d4bf14e7f49cdc, ASSIGN in 378 msec 2023-02-13 15:03:41,974 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2 2023-02-13 15:03:41,975 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2 2023-02-13 15:03:41,975 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23b3c280fb8fa33685d17b7e59c9c23b columnFamilyName f2 2023-02-13 15:03:41,975 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e288a4f22940d235d1c3d5680634f32 columnFamilyName f2 2023-02-13 15:03:41,976 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(310): Store=23b3c280fb8fa33685d17b7e59c9c23b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,976 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(310): Store=1e288a4f22940d235d1c3d5680634f32/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:41,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:41,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:41,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:41,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 23b3c280fb8fa33685d17b7e59c9c23b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65874954, jitterRate=-0.01838669180870056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:41,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 23b3c280fb8fa33685d17b7e59c9c23b: Running coprocessor pre-open hook at 1676300621966Writing region info on filesystem at 1676300621966Initializing all the Stores at 1676300621969 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621969Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621969Cleaning up temporary data from old regions at 1676300621978 (+9 ms)Cleaning up detritus from prior splits at 1676300621978Running coprocessor post-open hooks at 1676300621984 (+6 ms)Region opened successfully at 1676300621984 2023-02-13 15:03:41,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b., pid=24, masterSystemTime=1676300621908 2023-02-13 15:03:41,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:41,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:41,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:41,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:41,987 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=23b3c280fb8fa33685d17b7e59c9c23b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:41,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa676702bcb180694d8939267a94293f, NAME => 'testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 15:03:41,987 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621987"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300621987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300621987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300621987"}]},"ts":"1676300621987"} 2023-02-13 15:03:41,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:41,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1e288a4f22940d235d1c3d5680634f32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61252157, jitterRate=-0.08727173507213593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:41,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1e288a4f22940d235d1c3d5680634f32: Running coprocessor pre-open hook at 1676300621968Writing region info on filesystem at 1676300621968Initializing all the Stores at 1676300621969 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621969Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621969Cleaning up temporary data from old regions at 1676300621978 (+9 ms)Cleaning up detritus from prior splits at 1676300621978Running coprocessor post-open hooks at 1676300621989 (+11 ms)Region opened successfully at 1676300621989 2023-02-13 15:03:41,989 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32., pid=30, masterSystemTime=1676300621921 2023-02-13 15:03:41,991 DEBUG [StoreOpener-aa676702bcb180694d8939267a94293f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/f1 2023-02-13 15:03:41,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-13 15:03:41,991 DEBUG [StoreOpener-aa676702bcb180694d8939267a94293f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/f1 2023-02-13 15:03:41,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 23b3c280fb8fa33685d17b7e59c9c23b, server=jenkins-hbase20.apache.org,43261,1676300619749 in 231 msec 2023-02-13 15:03:41,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:41,991 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa676702bcb180694d8939267a94293f columnFamilyName f1 2023-02-13 15:03:41,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:41,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:41,992 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1e288a4f22940d235d1c3d5680634f32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:41,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 81790214badbeb2b84fbf777b424492a, NAME => 'testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 15:03:41,992 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300621992"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300621992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300621992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300621992"}]},"ts":"1676300621992"} 2023-02-13 15:03:41,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:41,992 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(310): Store=aa676702bcb180694d8939267a94293f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:41,992 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:41,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=23b3c280fb8fa33685d17b7e59c9c23b, ASSIGN in 396 msec 2023-02-13 15:03:41,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:41,994 DEBUG [StoreOpener-aa676702bcb180694d8939267a94293f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/f2 2023-02-13 15:03:41,994 DEBUG [StoreOpener-aa676702bcb180694d8939267a94293f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/f2 2023-02-13 15:03:41,994 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:41,994 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa676702bcb180694d8939267a94293f columnFamilyName f2 2023-02-13 15:03:41,995 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(310): Store=aa676702bcb180694d8939267a94293f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:41,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f 2023-02-13 15:03:41,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:42,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for aa676702bcb180694d8939267a94293f 2023-02-13 15:03:42,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:42,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened aa676702bcb180694d8939267a94293f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70581133, jitterRate=0.05174084007740021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:42,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for aa676702bcb180694d8939267a94293f: Running coprocessor pre-open hook at 1676300621988Writing region info on filesystem at 1676300621988Initializing all the Stores at 1676300621989 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621989Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621989Cleaning up temporary data from old regions at 1676300621997 (+8 ms)Cleaning up detritus from prior splits at 1676300621997Running coprocessor post-open hooks at 1676300622004 (+7 ms)Region opened successfully at 1676300622004 2023-02-13 15:03:42,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f., pid=25, masterSystemTime=1676300621908 2023-02-13 15:03:42,011 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1 2023-02-13 15:03:42,011 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1 2023-02-13 15:03:42,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:42,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:42,011 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81790214badbeb2b84fbf777b424492a columnFamilyName f1 2023-02-13 15:03:42,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-13 15:03:42,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 1e288a4f22940d235d1c3d5680634f32, server=jenkins-hbase20.apache.org,32935,1676300619701 in 223 msec 2023-02-13 15:03:42,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aa676702bcb180694d8939267a94293f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300622012"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300622012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300622012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300622012"}]},"ts":"1676300622012"} 2023-02-13 15:03:42,013 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(310): Store=81790214badbeb2b84fbf777b424492a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:42,013 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:42,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1e288a4f22940d235d1c3d5680634f32, ASSIGN in 417 msec 2023-02-13 15:03:42,015 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2 2023-02-13 15:03:42,015 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2 2023-02-13 15:03:42,016 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81790214badbeb2b84fbf777b424492a columnFamilyName f2 2023-02-13 15:03:42,017 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(310): Store=81790214badbeb2b84fbf777b424492a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:42,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-13 15:03:42,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure aa676702bcb180694d8939267a94293f, server=jenkins-hbase20.apache.org,43261,1676300619749 in 255 msec 2023-02-13 15:03:42,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:42,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:42,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aa676702bcb180694d8939267a94293f, ASSIGN in 423 msec 2023-02-13 15:03:42,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:42,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:42,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:42,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 81790214badbeb2b84fbf777b424492a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72523321, jitterRate=0.0806816965341568}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 81790214badbeb2b84fbf777b424492a: Running coprocessor pre-open hook at 1676300621993Writing region info on filesystem at 1676300621993Initializing all the Stores at 1676300621993Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621994 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300621994Cleaning up temporary data from old regions at 1676300622020 (+26 ms)Cleaning up detritus from prior splits at 1676300622021 (+1 ms)Running coprocessor post-open hooks at 1676300622033 (+12 ms)Region opened successfully at 1676300622033 2023-02-13 15:03:42,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a., pid=29, masterSystemTime=1676300621921 2023-02-13 15:03:42,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:42,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:42,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:42,038 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=81790214badbeb2b84fbf777b424492a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1cf110e0ba97a96edb7093e36a32c37f, NAME => 'testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 15:03:42,038 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676300621114.81790214badbeb2b84fbf777b424492a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676300622038"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300622038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300622038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300622038"}]},"ts":"1676300622038"} 2023-02-13 15:03:42,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:42,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-13 15:03:42,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure 81790214badbeb2b84fbf777b424492a, server=jenkins-hbase20.apache.org,32935,1676300619701 in 270 msec 2023-02-13 15:03:42,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=81790214badbeb2b84fbf777b424492a, ASSIGN in 447 msec 2023-02-13 15:03:42,053 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,056 DEBUG [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/f1 2023-02-13 15:03:42,056 DEBUG [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/f1 2023-02-13 15:03:42,057 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cf110e0ba97a96edb7093e36a32c37f columnFamilyName f1 2023-02-13 15:03:42,058 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(310): Store=1cf110e0ba97a96edb7093e36a32c37f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:42,058 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,077 DEBUG [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/f2 2023-02-13 15:03:42,077 DEBUG [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/f2 2023-02-13 15:03:42,077 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cf110e0ba97a96edb7093e36a32c37f columnFamilyName f2 2023-02-13 15:03:42,079 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(310): Store=1cf110e0ba97a96edb7093e36a32c37f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:42,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:42,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:42,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:42,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1cf110e0ba97a96edb7093e36a32c37f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60324575, jitterRate=-0.10109378397464752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:42,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1cf110e0ba97a96edb7093e36a32c37f: Running coprocessor pre-open hook at 1676300622039Writing region info on filesystem at 1676300622039Initializing all the Stores at 1676300622040 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300622040Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300622053 (+13 ms)Cleaning up temporary data from old regions at 1676300622082 (+29 ms)Cleaning up detritus from prior splits at 1676300622092 (+10 ms)Running coprocessor post-open hooks at 1676300622105 (+13 ms)Region opened successfully at 1676300622105 2023-02-13 15:03:42,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f., pid=26, masterSystemTime=1676300621921 2023-02-13 15:03:42,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:42,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:42,108 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1cf110e0ba97a96edb7093e36a32c37f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,108 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676300622108"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300622108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300622108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300622108"}]},"ts":"1676300622108"} 2023-02-13 15:03:42,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-13 15:03:42,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure 1cf110e0ba97a96edb7093e36a32c37f, server=jenkins-hbase20.apache.org,32935,1676300619701 in 346 msec 2023-02-13 15:03:42,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 15:03:42,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1cf110e0ba97a96edb7093e36a32c37f, ASSIGN in 521 msec 2023-02-13 15:03:42,118 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:42,118 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300622118"}]},"ts":"1676300622118"} 2023-02-13 15:03:42,120 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 15:03:42,122 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:42,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.0070 sec 2023-02-13 15:03:42,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:42,228 INFO [Listener at localhost.localdomain/40345] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 15:03:42,228 DEBUG [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 15:03:42,228 INFO [Listener at localhost.localdomain/40345] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:42,232 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 15:03:42,233 INFO [Listener at localhost.localdomain/40345] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:42,233 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 15:03:42,233 INFO [Listener at localhost.localdomain/40345] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 15:03:42,300 DEBUG [hconnection-0x7473d711-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:42,307 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43261] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:42,316 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:42,324 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32935] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:42,445 INFO [Listener at localhost.localdomain/40345] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 15:03:42,446 INFO [Listener at localhost.localdomain/40345] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 15:03:42,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:03:42,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676300622447 (current time:1676300622447). 2023-02-13 15:03:42,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 15:03:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] zookeeper.ReadOnlyZKClient(139): Connect 0x3f775ae1 to 127.0.0.1:52423 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:42,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26e40778, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:42,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:42,460 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51380, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:42,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f775ae1 to 127.0.0.1:52423 2023-02-13 15:03:42,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:42,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 15:03:42,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:03:42,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:03:42,466 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:03:42,467 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676301222467 2023-02-13 15:03:42,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:03:42,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 15:03:42,469 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:42,469 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 15:03:42,470 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:03:42,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:03:42,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-13 15:03:42,472 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:03:42,473 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676301222473 2023-02-13 15:03:42,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,488 INFO [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-13 15:03:42,488 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:42,489 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-13 15:03:42,489 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-13 15:03:42,570 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:42,572 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,572 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:42,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:42,572 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 15:03:42,573 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:42,573 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:42,573 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:42,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:42,573 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,573 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,573 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,573 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:42,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,574 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 15:03:42,574 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:42,574 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 15:03:42,575 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 15:03:42,575 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 15:03:42,575 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:42,575 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43261,1676300619749' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 15:03:42,576 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 15:03:42,576 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 15:03:42,576 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32935,1676300619701' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 15:03:42,577 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:42,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,577 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,578 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:42,578 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,578 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:42,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43261,1676300619749' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 15:03:42,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8053146[Count = 1] remaining members to acquire global barrier 2023-02-13 15:03:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:42,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:42,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:42,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32935,1676300619701' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 15:03:42,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8053146[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:42,581 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-13 15:03:42,581 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,582 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,582 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,582 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:42,582 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,582 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:42,582 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:42,582 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:42,582 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. started... 2023-02-13 15:03:42,582 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:42,582 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:42,583 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 15:03:42,583 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:03:42,582 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. started... 2023-02-13 15:03:42,582 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:42,583 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:42,583 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 81790214badbeb2b84fbf777b424492a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:42,584 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. started... 2023-02-13 15:03:42,584 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. started... 2023-02-13 15:03:42,585 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:42,585 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3e7b613215d42c7bacf205bef8677c14 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:42,586 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. started... 2023-02-13 15:03:42,585 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HRegion(2744): Flushing fc2a1fd673f2e19effb20f01b21bea03 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 15:03:42,585 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1e288a4f22940d235d1c3d5680634f32 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:42,586 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 15:03:42,592 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:03:42,591 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 23b3c280fb8fa33685d17b7e59c9c23b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:42,591 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:42,593 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. started... 2023-02-13 15:03:42,594 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 896400298655c8a2b00fed5bcd208f1f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:42,606 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 15:03:42,662 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f1/5525d9f5ca0b45a198536b74e352c678 2023-02-13 15:03:42,669 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f1/791dafff5f784891af4a763e6c6b269f 2023-02-13 15:03:42,680 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f1/6832c16c17d2479fb73b85a46139b011 2023-02-13 15:03:42,689 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f1/091d184bb2a14b86a881e38bdfc182ad 2023-02-13 15:03:42,693 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f1/8a2f2badb7fa4dafb93be475c681db54 2023-02-13 15:03:42,699 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f1/c4c5a2d2edf445dd967482ac365e753e 2023-02-13 15:03:42,751 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f2/eca5a33809c04283b9d6e196d47802c5 2023-02-13 15:03:42,758 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f1/791dafff5f784891af4a763e6c6b269f as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1/791dafff5f784891af4a763e6c6b269f 2023-02-13 15:03:42,764 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1/791dafff5f784891af4a763e6c6b269f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:42,765 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f2/eca5a33809c04283b9d6e196d47802c5 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2/eca5a33809c04283b9d6e196d47802c5 2023-02-13 15:03:42,773 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:42,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:42,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:42,774 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 15:03:42,790 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2/eca5a33809c04283b9d6e196d47802c5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:42,792 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1e288a4f22940d235d1c3d5680634f32 in 206ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:42,792 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 15:03:42,792 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1e288a4f22940d235d1c3d5680634f32: 2023-02-13 15:03:42,793 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,793 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:42,793 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1/791dafff5f784891af4a763e6c6b269f] hfiles 2023-02-13 15:03:42,793 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1/791dafff5f784891af4a763e6c6b269f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,793 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2/eca5a33809c04283b9d6e196d47802c5] hfiles 2023-02-13 15:03:42,793 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2/eca5a33809c04283b9d6e196d47802c5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,795 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f2/a595a093aa7743d99df958b3c9d31547 2023-02-13 15:03:42,815 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f2/1b566d7a8756405da62e31e45a7d8b27 2023-02-13 15:03:42,818 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f2/587b3d6041fb40eca8c80b30d22861f8 2023-02-13 15:03:42,822 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f1/6832c16c17d2479fb73b85a46139b011 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1/6832c16c17d2479fb73b85a46139b011 2023-02-13 15:03:42,825 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f1/c4c5a2d2edf445dd967482ac365e753e as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1/c4c5a2d2edf445dd967482ac365e753e 2023-02-13 15:03:42,834 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f1/8a2f2badb7fa4dafb93be475c681db54 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1/8a2f2badb7fa4dafb93be475c681db54 2023-02-13 15:03:42,836 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f2/14e7a8492cc1475c88fc563f6cf25bb8 2023-02-13 15:03:42,836 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1/6832c16c17d2479fb73b85a46139b011, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:42,836 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1/c4c5a2d2edf445dd967482ac365e753e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:42,838 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f2/1b566d7a8756405da62e31e45a7d8b27 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2/1b566d7a8756405da62e31e45a7d8b27 2023-02-13 15:03:42,839 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f2/a595a093aa7743d99df958b3c9d31547 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2/a595a093aa7743d99df958b3c9d31547 2023-02-13 15:03:42,848 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. completed. 2023-02-13 15:03:42,848 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:42,848 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:42,848 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 15:03:42,848 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. started... 2023-02-13 15:03:42,856 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 075e7e62d8986f2db8d4bf14e7f49cdc 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 15:03:42,858 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1/8a2f2badb7fa4dafb93be475c681db54, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:42,858 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2/1b566d7a8756405da62e31e45a7d8b27, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:42,859 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2/a595a093aa7743d99df958b3c9d31547, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:42,859 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for fc2a1fd673f2e19effb20f01b21bea03 in 274ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fc2a1fd673f2e19effb20f01b21bea03: 2023-02-13 15:03:42,861 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 896400298655c8a2b00fed5bcd208f1f in 267ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 896400298655c8a2b00fed5bcd208f1f: 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1/c4c5a2d2edf445dd967482ac365e753e] hfiles 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1/6832c16c17d2479fb73b85a46139b011] hfiles 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1/c4c5a2d2edf445dd967482ac365e753e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1/6832c16c17d2479fb73b85a46139b011 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2/1b566d7a8756405da62e31e45a7d8b27] hfiles 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2/a595a093aa7743d99df958b3c9d31547] hfiles 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2/a595a093aa7743d99df958b3c9d31547 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,861 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2/1b566d7a8756405da62e31e45a7d8b27 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:42,862 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f2/587b3d6041fb40eca8c80b30d22861f8 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2/587b3d6041fb40eca8c80b30d22861f8 2023-02-13 15:03:42,862 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f1/091d184bb2a14b86a881e38bdfc182ad as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1/091d184bb2a14b86a881e38bdfc182ad 2023-02-13 15:03:42,873 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1/091d184bb2a14b86a881e38bdfc182ad, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:42,874 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f2/14e7a8492cc1475c88fc563f6cf25bb8 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2/14e7a8492cc1475c88fc563f6cf25bb8 2023-02-13 15:03:42,884 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2/587b3d6041fb40eca8c80b30d22861f8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:42,884 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2/14e7a8492cc1475c88fc563f6cf25bb8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:43,074 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:43,079 INFO [AsyncFSWAL-0-hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a-prefix:jenkins-hbase20.apache.org,43261,1676300619749] wal.AbstractFSWAL(1045): Slow sync cost: 193 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:43587,DS-761153d1-7c71-48b9-867d-327c2a639521,DISK], DatanodeInfoWithStorage[127.0.0.1:35103,DS-086aa068-fc6b-4e71-b329-a2199341573a,DISK]] 2023-02-13 15:03:43,079 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 23b3c280fb8fa33685d17b7e59c9c23b in 487ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:43,079 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3e7b613215d42c7bacf205bef8677c14 in 494ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:43,081 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. completed. 2023-02-13 15:03:43,082 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:43,082 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:43,082 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. started... 2023-02-13 15:03:43,082 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5929cc1c7b5c57368512e5d14cd0ee1a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:43,083 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 15:03:43,081 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. completed. 2023-02-13 15:03:43,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:43,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:43,080 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 23b3c280fb8fa33685d17b7e59c9c23b: 2023-02-13 15:03:43,083 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f1/0443ccfc16a0481aae4c818372e7b7a5 2023-02-13 15:03:43,083 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,083 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 15:03:43,083 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. started... 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1cf110e0ba97a96edb7093e36a32c37f: 2023-02-13 15:03:43,082 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3e7b613215d42c7bacf205bef8677c14: 2023-02-13 15:03:43,084 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 15:03:43,083 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1/8a2f2badb7fa4dafb93be475c681db54] hfiles 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1/8a2f2badb7fa4dafb93be475c681db54 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2/587b3d6041fb40eca8c80b30d22861f8] hfiles 2023-02-13 15:03:43,084 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2/587b3d6041fb40eca8c80b30d22861f8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1/091d184bb2a14b86a881e38bdfc182ad] hfiles 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1/091d184bb2a14b86a881e38bdfc182ad for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2/14e7a8492cc1475c88fc563f6cf25bb8] hfiles 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2/14e7a8492cc1475c88fc563f6cf25bb8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,085 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:43,104 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. completed. 2023-02-13 15:03:43,104 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:43,104 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 15:03:43,113 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. completed. 2023-02-13 15:03:43,113 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:43,113 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:43,113 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 15:03:43,113 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. started... 2023-02-13 15:03:43,113 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for aa676702bcb180694d8939267a94293f: 2023-02-13 15:03:43,113 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,113 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:43,114 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:43,114 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:43,119 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f1/57941c5481ca44a7afdf7e3541842288 2023-02-13 15:03:43,121 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. completed. 2023-02-13 15:03:43,122 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:43,122 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 15:03:43,125 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f2/4f10a34085fc40ae966b98520f74a84f 2023-02-13 15:03:43,127 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. completed. 2023-02-13 15:03:43,127 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:43,127 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 15:03:43,131 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f1/0443ccfc16a0481aae4c818372e7b7a5 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1/0443ccfc16a0481aae4c818372e7b7a5 2023-02-13 15:03:43,136 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1/0443ccfc16a0481aae4c818372e7b7a5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:43,137 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f2/4f10a34085fc40ae966b98520f74a84f as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2/4f10a34085fc40ae966b98520f74a84f 2023-02-13 15:03:43,142 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2/4f10a34085fc40ae966b98520f74a84f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:43,143 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 075e7e62d8986f2db8d4bf14e7f49cdc in 290ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:43,143 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 075e7e62d8986f2db8d4bf14e7f49cdc: 2023-02-13 15:03:43,143 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,143 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:43,143 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1/0443ccfc16a0481aae4c818372e7b7a5] hfiles 2023-02-13 15:03:43,143 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1/0443ccfc16a0481aae4c818372e7b7a5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,144 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2/4f10a34085fc40ae966b98520f74a84f] hfiles 2023-02-13 15:03:43,144 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2/4f10a34085fc40ae966b98520f74a84f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,145 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f2/d0646e0b54544584a7edb241bd9cdbcf 2023-02-13 15:03:43,151 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. completed. 2023-02-13 15:03:43,151 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:43,151 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 15:03:43,151 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f1/57941c5481ca44a7afdf7e3541842288 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1/57941c5481ca44a7afdf7e3541842288 2023-02-13 15:03:43,156 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1/57941c5481ca44a7afdf7e3541842288, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:43,157 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f2/d0646e0b54544584a7edb241bd9cdbcf as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2/d0646e0b54544584a7edb241bd9cdbcf 2023-02-13 15:03:43,162 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2/d0646e0b54544584a7edb241bd9cdbcf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:43,163 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5929cc1c7b5c57368512e5d14cd0ee1a in 81ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:43,163 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5929cc1c7b5c57368512e5d14cd0ee1a: 2023-02-13 15:03:43,163 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,163 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:43,163 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1/57941c5481ca44a7afdf7e3541842288] hfiles 2023-02-13 15:03:43,163 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1/57941c5481ca44a7afdf7e3541842288 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,163 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2/d0646e0b54544584a7edb241bd9cdbcf] hfiles 2023-02-13 15:03:43,163 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2/d0646e0b54544584a7edb241bd9cdbcf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,170 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. completed. 2023-02-13 15:03:43,170 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:43,171 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 15:03:43,171 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 15:03:43,171 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,171 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 15:03:43,171 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,43261,1676300619749' in zk 2023-02-13 15:03:43,172 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,172 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 15:03:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:43,172 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:43,172 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 15:03:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:43,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:43,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,43261,1676300619749': 2023-02-13 15:03:43,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43261,1676300619749' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 15:03:43,185 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f2/7c3fded42775464ba8309d9198f2f86e 2023-02-13 15:03:43,192 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f1/5525d9f5ca0b45a198536b74e352c678 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1/5525d9f5ca0b45a198536b74e352c678 2023-02-13 15:03:43,197 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1/5525d9f5ca0b45a198536b74e352c678, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:43,198 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f2/7c3fded42775464ba8309d9198f2f86e as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2/7c3fded42775464ba8309d9198f2f86e 2023-02-13 15:03:43,203 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2/7c3fded42775464ba8309d9198f2f86e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:43,204 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 81790214badbeb2b84fbf777b424492a in 621ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:43,204 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 81790214badbeb2b84fbf777b424492a: 2023-02-13 15:03:43,204 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,205 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:43,205 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1/5525d9f5ca0b45a198536b74e352c678] hfiles 2023-02-13 15:03:43,205 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1/5525d9f5ca0b45a198536b74e352c678 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,205 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2/7c3fded42775464ba8309d9198f2f86e] hfiles 2023-02-13 15:03:43,205 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2/7c3fded42775464ba8309d9198f2f86e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,211 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. completed. 2023-02-13 15:03:43,211 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:43,211 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 15:03:43,211 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 15:03:43,211 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,211 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 15:03:43,211 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,32935,1676300619701' in zk 2023-02-13 15:03:43,212 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 15:03:43,212 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,212 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:43,212 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 15:03:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:43,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,32935,1676300619701': 2023-02-13 15:03:43,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32935,1676300619701' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 15:03:43,216 INFO [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-13 15:03:43,216 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:43,216 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:43,216 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,216 INFO [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 15:03:43,217 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:43,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,217 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:43,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:43,217 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:43,218 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,218 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:43,219 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,220 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,229 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:43,229 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:43,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:43,229 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:43,229 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,230 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,230 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:43,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:43,230 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:43,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:43,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:43,230 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,231 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,231 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:43,231 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:43,231 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:43,231 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:43,231 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-13 15:03:43,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,299 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:43,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676300622467Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676300623230 (+763 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676300623231 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676300623248 (+17 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676300623260 (+12 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676300623299 (+39 ms) 2023-02-13 15:03:43,301 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:03:43,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 833 msec 2023-02-13 15:03:43,584 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:43,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:03:43,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 15:03:43,585 INFO [Listener at localhost.localdomain/40345] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 15:03:43,590 INFO [Listener at localhost.localdomain/40345] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 15:03:43,599 INFO [Listener at localhost.localdomain/40345] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 15:03:43,639 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43261] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:43,642 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32935] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:43,711 INFO [Listener at localhost.localdomain/40345] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 15:03:43,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 15:03:43,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 15:03:43,722 INFO [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 15:03:43,722 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:43,723 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 15:03:43,723 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 15:03:43,724 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:43,724 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:43,725 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:43,725 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:43,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:43,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:43,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:43,725 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:43,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:43,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:43,725 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:43,725 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:43,726 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:43,726 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 15:03:43,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 15:03:43,727 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 15:03:43,727 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:43,732 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 15:03:43,732 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 15:03:43,732 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:43,732 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:43,733 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 15:03:43,733 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. started... 2023-02-13 15:03:43,733 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:43,733 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. started... 2023-02-13 15:03:43,733 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 81790214badbeb2b84fbf777b424492a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:43,733 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1e288a4f22940d235d1c3d5680634f32 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:43,735 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 15:03:43,735 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:03:43,735 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:43,735 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. started... 2023-02-13 15:03:43,735 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fc2a1fd673f2e19effb20f01b21bea03 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 15:03:43,740 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:43,740 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. started... 2023-02-13 15:03:43,744 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3e7b613215d42c7bacf205bef8677c14 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:43,744 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 15:03:43,744 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:03:43,744 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:43,744 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. started... 2023-02-13 15:03:43,744 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 23b3c280fb8fa33685d17b7e59c9c23b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:43,745 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:43,745 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. started... 2023-02-13 15:03:43,745 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 896400298655c8a2b00fed5bcd208f1f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:43,791 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f1/174d172d89434260bb924b1eecd283b8 2023-02-13 15:03:43,791 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f1/5d41cd2ef5244db0a835bde27545ffca 2023-02-13 15:03:43,807 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f1/37a62b10c4fa446c9c4d15703f13496a 2023-02-13 15:03:43,815 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f1/c254dc69c48a4e849ecdad84fc5b8fb9 2023-02-13 15:03:43,827 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f1/7aa8c3feb0d84b19be7288d6e15261c3 2023-02-13 15:03:43,856 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f2/932d256119774a4b81f7eb94598e95c3 2023-02-13 15:03:43,856 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f2/be4b87fb873a4775a3be1e95b0269fa2 2023-02-13 15:03:43,862 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f1/c254dc69c48a4e849ecdad84fc5b8fb9 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1/c254dc69c48a4e849ecdad84fc5b8fb9 2023-02-13 15:03:43,864 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f1/37a62b10c4fa446c9c4d15703f13496a as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1/37a62b10c4fa446c9c4d15703f13496a 2023-02-13 15:03:43,868 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f2/b0613444dcf9491fa1f42dc6467867a2 2023-02-13 15:03:43,871 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1/37a62b10c4fa446c9c4d15703f13496a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:43,871 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1/c254dc69c48a4e849ecdad84fc5b8fb9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:43,872 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/.tmp/f2/932d256119774a4b81f7eb94598e95c3 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2/932d256119774a4b81f7eb94598e95c3 2023-02-13 15:03:43,873 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/.tmp/f2/be4b87fb873a4775a3be1e95b0269fa2 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2/be4b87fb873a4775a3be1e95b0269fa2 2023-02-13 15:03:43,877 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f1/7aa8c3feb0d84b19be7288d6e15261c3 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1/7aa8c3feb0d84b19be7288d6e15261c3 2023-02-13 15:03:43,879 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2/932d256119774a4b81f7eb94598e95c3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:43,880 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 896400298655c8a2b00fed5bcd208f1f in 135ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:43,880 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 896400298655c8a2b00fed5bcd208f1f: 2023-02-13 15:03:43,880 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:43,880 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:43,880 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 15:03:43,880 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. started... 2023-02-13 15:03:43,881 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5929cc1c7b5c57368512e5d14cd0ee1a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:43,881 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2/be4b87fb873a4775a3be1e95b0269fa2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:43,886 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for fc2a1fd673f2e19effb20f01b21bea03 in 151ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:43,886 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fc2a1fd673f2e19effb20f01b21bea03: 2023-02-13 15:03:43,886 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:43,886 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:43,886 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 15:03:43,886 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. started... 2023-02-13 15:03:43,887 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 075e7e62d8986f2db8d4bf14e7f49cdc 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 15:03:43,892 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1/7aa8c3feb0d84b19be7288d6e15261c3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:43,896 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/.tmp/f2/b0613444dcf9491fa1f42dc6467867a2 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2/b0613444dcf9491fa1f42dc6467867a2 2023-02-13 15:03:43,906 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2/b0613444dcf9491fa1f42dc6467867a2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:43,907 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3e7b613215d42c7bacf205bef8677c14 in 164ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:43,907 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3e7b613215d42c7bacf205bef8677c14: 2023-02-13 15:03:43,907 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:43,908 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:43,908 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 15:03:43,908 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. started... 2023-02-13 15:03:43,908 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aa676702bcb180694d8939267a94293f: 2023-02-13 15:03:43,908 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:43,908 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 15:03:43,915 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f1/96358cdd3a9148c1b67c7628c618610a 2023-02-13 15:03:43,918 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f1/67d5eec2920b40dfb216aaafbf0f88c1 2023-02-13 15:03:43,937 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f2/029fbf6cb41c475f97b3981193e8a93e 2023-02-13 15:03:43,939 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f2/2196acc4670045b396d4d3d99e51ee80 2023-02-13 15:03:43,943 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f1/96358cdd3a9148c1b67c7628c618610a as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1/96358cdd3a9148c1b67c7628c618610a 2023-02-13 15:03:43,943 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f1/67d5eec2920b40dfb216aaafbf0f88c1 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1/67d5eec2920b40dfb216aaafbf0f88c1 2023-02-13 15:03:43,948 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1/96358cdd3a9148c1b67c7628c618610a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:43,948 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1/67d5eec2920b40dfb216aaafbf0f88c1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:43,949 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/.tmp/f2/029fbf6cb41c475f97b3981193e8a93e as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2/029fbf6cb41c475f97b3981193e8a93e 2023-02-13 15:03:43,949 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/.tmp/f2/2196acc4670045b396d4d3d99e51ee80 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2/2196acc4670045b396d4d3d99e51ee80 2023-02-13 15:03:43,955 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2/029fbf6cb41c475f97b3981193e8a93e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:43,956 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2/2196acc4670045b396d4d3d99e51ee80, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:43,956 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5929cc1c7b5c57368512e5d14cd0ee1a in 75ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:43,956 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5929cc1c7b5c57368512e5d14cd0ee1a: 2023-02-13 15:03:43,956 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:43,956 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 15:03:43,957 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 075e7e62d8986f2db8d4bf14e7f49cdc in 69ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:43,957 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 075e7e62d8986f2db8d4bf14e7f49cdc: 2023-02-13 15:03:43,957 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:43,957 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:43,957 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 15:03:43,957 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. started... 2023-02-13 15:03:43,957 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1cf110e0ba97a96edb7093e36a32c37f: 2023-02-13 15:03:43,957 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:43,957 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 15:03:44,188 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f1/3ca032c310a24f8397d7456f8f71cb95 2023-02-13 15:03:44,204 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f2/9478432c69a04177a8b28a1cededdbca 2023-02-13 15:03:44,210 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f1/3ca032c310a24f8397d7456f8f71cb95 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1/3ca032c310a24f8397d7456f8f71cb95 2023-02-13 15:03:44,215 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1/3ca032c310a24f8397d7456f8f71cb95, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:44,216 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/.tmp/f2/9478432c69a04177a8b28a1cededdbca as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2/9478432c69a04177a8b28a1cededdbca 2023-02-13 15:03:44,220 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2/9478432c69a04177a8b28a1cededdbca, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:44,221 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1e288a4f22940d235d1c3d5680634f32 in 488ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:44,221 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1e288a4f22940d235d1c3d5680634f32: 2023-02-13 15:03:44,221 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:44,221 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 15:03:44,246 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f2/b1c7192befa54c1f86cd24aaeb70d2b1 2023-02-13 15:03:44,247 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f2/70cf93999e1d4e8ea5c33d38dcc710ea 2023-02-13 15:03:44,251 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f1/174d172d89434260bb924b1eecd283b8 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1/174d172d89434260bb924b1eecd283b8 2023-02-13 15:03:44,252 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f1/5d41cd2ef5244db0a835bde27545ffca as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1/5d41cd2ef5244db0a835bde27545ffca 2023-02-13 15:03:44,256 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1/5d41cd2ef5244db0a835bde27545ffca, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:44,256 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1/174d172d89434260bb924b1eecd283b8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:44,257 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/.tmp/f2/70cf93999e1d4e8ea5c33d38dcc710ea as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2/70cf93999e1d4e8ea5c33d38dcc710ea 2023-02-13 15:03:44,257 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/.tmp/f2/b1c7192befa54c1f86cd24aaeb70d2b1 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2/b1c7192befa54c1f86cd24aaeb70d2b1 2023-02-13 15:03:44,262 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2/70cf93999e1d4e8ea5c33d38dcc710ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:44,262 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2/b1c7192befa54c1f86cd24aaeb70d2b1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:44,263 INFO [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 81790214badbeb2b84fbf777b424492a in 530ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:44,263 INFO [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 23b3c280fb8fa33685d17b7e59c9c23b in 519ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:44,263 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 81790214badbeb2b84fbf777b424492a: 2023-02-13 15:03:44,263 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 23b3c280fb8fa33685d17b7e59c9c23b: 2023-02-13 15:03:44,263 DEBUG [rs(jenkins-hbase20.apache.org,32935,1676300619701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:44,263 DEBUG [rs(jenkins-hbase20.apache.org,43261,1676300619749)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:44,263 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 15:03:44,263 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 15:03:44,263 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 15:03:44,264 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 15:03:44,264 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,264 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,264 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 15:03:44,264 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 15:03:44,264 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43261,1676300619749' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 15:03:44,264 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32935,1676300619701' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 15:03:44,265 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,265 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,265 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:44,265 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:44,268 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,268 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:44,268 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,268 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:44,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:44,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:44,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43261,1676300619749' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 15:03:44,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c3aa49e[Count = 1] remaining members to acquire global barrier 2023-02-13 15:03:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:44,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:44,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32935,1676300619701' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 15:03:44,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c3aa49e[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:44,272 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 15:03:44,272 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,278 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,278 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,279 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 15:03:44,279 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 15:03:44,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,279 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,279 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 15:03:44,279 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 15:03:44,279 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,32935,1676300619701' in zk 2023-02-13 15:03:44,279 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,43261,1676300619749' in zk 2023-02-13 15:03:44,279 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,279 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:44,282 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 15:03:44,282 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,282 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:44,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,282 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,282 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 15:03:44,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:44,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:44,282 DEBUG [member: 'jenkins-hbase20.apache.org,43261,1676300619749' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 15:03:44,283 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:44,283 DEBUG [member: 'jenkins-hbase20.apache.org,32935,1676300619701' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 15:03:44,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:44,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:44,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:44,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,43261,1676300619749': 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43261,1676300619749' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,32935,1676300619701': 2023-02-13 15:03:44,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32935,1676300619701' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 15:03:44,289 INFO [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 15:03:44,289 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:44,289 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:44,289 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 15:03:44,289 INFO [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 15:03:44,295 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,295 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,295 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:44,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,295 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:44,295 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:44,296 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:44,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:44,296 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,298 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:44,298 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:03:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,303 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,303 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:44,303 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:44,304 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:44,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:44,304 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:44,304 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:44,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 15:03:44,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 15:03:44,304 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:44,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:44,304 DEBUG [(jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:44,304 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:03:44,304 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,305 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,305 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,305 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:44,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:44,305 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 15:03:44,305 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:03:44,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:44,305 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:03:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:44,406 DEBUG [Listener at localhost.localdomain/40345] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 15:03:44,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44327] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 15:03:44,407 INFO [Listener at localhost.localdomain/40345] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 15:03:44,408 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x030f4123 to 127.0.0.1:52423 2023-02-13 15:03:44,408 DEBUG [Listener at localhost.localdomain/40345] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:44,408 DEBUG [Listener at localhost.localdomain/40345] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 15:03:44,408 DEBUG [Listener at localhost.localdomain/40345] util.JVMClusterUtil(257): Found active master hash=643152831, stopped=false 2023-02-13 15:03:44,408 INFO [Listener at localhost.localdomain/40345] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:44,409 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:44,409 INFO [Listener at localhost.localdomain/40345] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 15:03:44,409 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:44,409 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:44,409 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:44,410 DEBUG [Listener at localhost.localdomain/40345] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a310d34 to 127.0.0.1:52423 2023-02-13 15:03:44,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:44,410 DEBUG [Listener at localhost.localdomain/40345] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:44,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:44,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:44,410 INFO [Listener at localhost.localdomain/40345] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,32935,1676300619701' ***** 2023-02-13 15:03:44,411 INFO [Listener at localhost.localdomain/40345] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:44,411 INFO [Listener at localhost.localdomain/40345] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,43261,1676300619749' ***** 2023-02-13 15:03:44,411 INFO [RS:0;jenkins-hbase20:32935] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:44,411 INFO [RS:0;jenkins-hbase20:32935] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:44,411 INFO [RS:0;jenkins-hbase20:32935] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:44,411 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(3304): Received CLOSE for 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:44,411 INFO [Listener at localhost.localdomain/40345] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:44,411 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(3304): Received CLOSE for 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:44,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 81790214badbeb2b84fbf777b424492a, disabling compactions & flushes 2023-02-13 15:03:44,411 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:44,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:44,411 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(3304): Received CLOSE for fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:44,411 INFO [RS:1;jenkins-hbase20:43261] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:44,412 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(3304): Received CLOSE for 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:44,412 INFO [RS:1;jenkins-hbase20:43261] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:44,412 INFO [RS:1;jenkins-hbase20:43261] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:44,412 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(3304): Received CLOSE for 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:44,413 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(3304): Received CLOSE for 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:44,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 3e7b613215d42c7bacf205bef8677c14, disabling compactions & flushes 2023-02-13 15:03:44,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:44,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:44,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. after waiting 0 ms 2023-02-13 15:03:44,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:44,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:44,413 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(3304): Received CLOSE for 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:44,412 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(3304): Received CLOSE for e18c304667822681dc9348fd5e92d4c1 2023-02-13 15:03:44,416 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(3304): Received CLOSE for 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:44,412 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:44,416 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(3304): Received CLOSE for aa676702bcb180694d8939267a94293f 2023-02-13 15:03:44,416 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(3304): Received CLOSE for 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:44,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. after waiting 0 ms 2023-02-13 15:03:44,417 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,417 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,419 DEBUG [RS:0;jenkins-hbase20:32935] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fffee61 to 127.0.0.1:52423 2023-02-13 15:03:44,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:44,419 DEBUG [RS:0;jenkins-hbase20:32935] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:44,419 DEBUG [RS:1;jenkins-hbase20:43261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78f16bde to 127.0.0.1:52423 2023-02-13 15:03:44,419 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 15:03:44,419 DEBUG [RS:1;jenkins-hbase20:43261] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:44,419 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1479): Online Regions={81790214badbeb2b84fbf777b424492a=testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a., 1e288a4f22940d235d1c3d5680634f32=testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32., fc2a1fd673f2e19effb20f01b21bea03=testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03., 075e7e62d8986f2db8d4bf14e7f49cdc=testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc., e18c304667822681dc9348fd5e92d4c1=hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1., 1cf110e0ba97a96edb7093e36a32c37f=testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.} 2023-02-13 15:03:44,419 INFO [RS:1;jenkins-hbase20:43261] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:44,419 INFO [RS:1;jenkins-hbase20:43261] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:44,420 DEBUG [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1505): Waiting on 075e7e62d8986f2db8d4bf14e7f49cdc, 1cf110e0ba97a96edb7093e36a32c37f, 1e288a4f22940d235d1c3d5680634f32, 81790214badbeb2b84fbf777b424492a, e18c304667822681dc9348fd5e92d4c1, fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:44,420 INFO [RS:1;jenkins-hbase20:43261] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:44,420 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 15:03:44,422 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 15:03:44,423 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1479): Online Regions={3e7b613215d42c7bacf205bef8677c14=testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14., 23b3c280fb8fa33685d17b7e59c9c23b=testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b., 1588230740=hbase:meta,,1.1588230740, 896400298655c8a2b00fed5bcd208f1f=testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f., 5929cc1c7b5c57368512e5d14cd0ee1a=testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a., aa676702bcb180694d8939267a94293f=testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.} 2023-02-13 15:03:44,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:44,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:44,423 DEBUG [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1505): Waiting on 1588230740, 23b3c280fb8fa33685d17b7e59c9c23b, 3e7b613215d42c7bacf205bef8677c14, 5929cc1c7b5c57368512e5d14cd0ee1a, 896400298655c8a2b00fed5bcd208f1f, aa676702bcb180694d8939267a94293f 2023-02-13 15:03:44,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:44,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:44,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:44,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.97 KB heapSize=23.05 KB 2023-02-13 15:03:44,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:44,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 3e7b613215d42c7bacf205bef8677c14: Waiting for close lock at 1676300624413Running coprocessor pre-close hooks at 1676300624413Disabling compacts and flushes for region at 1676300624413Disabling writes for close at 1676300624413Writing region close event to WAL at 1676300624419 (+6 ms)Running coprocessor post-close hooks at 1676300624435 (+16 ms)Closed at 1676300624436 (+1 ms) 2023-02-13 15:03:44,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:44,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 23b3c280fb8fa33685d17b7e59c9c23b, disabling compactions & flushes 2023-02-13 15:03:44,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:44,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:44,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. after waiting 0 ms 2023-02-13 15:03:44,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:44,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:44,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 81790214badbeb2b84fbf777b424492a: Waiting for close lock at 1676300624411Running coprocessor pre-close hooks at 1676300624411Disabling compacts and flushes for region at 1676300624411Disabling writes for close at 1676300624417 (+6 ms)Writing region close event to WAL at 1676300624434 (+17 ms)Running coprocessor post-close hooks at 1676300624447 (+13 ms)Closed at 1676300624448 (+1 ms) 2023-02-13 15:03:44,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:44,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1e288a4f22940d235d1c3d5680634f32, disabling compactions & flushes 2023-02-13 15:03:44,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:44,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:44,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. after waiting 0 ms 2023-02-13 15:03:44,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:44,448 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.78 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/.tmp/info/36fecec02f1b42518b80744bef9d5c49 2023-02-13 15:03:44,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:44,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 23b3c280fb8fa33685d17b7e59c9c23b: Waiting for close lock at 1676300624436Running coprocessor pre-close hooks at 1676300624436Disabling compacts and flushes for region at 1676300624436Disabling writes for close at 1676300624436Writing region close event to WAL at 1676300624443 (+7 ms)Running coprocessor post-close hooks at 1676300624456 (+13 ms)Closed at 1676300624456 2023-02-13 15:03:44,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:44,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 896400298655c8a2b00fed5bcd208f1f, disabling compactions & flushes 2023-02-13 15:03:44,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:44,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:44,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. after waiting 0 ms 2023-02-13 15:03:44,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:44,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:44,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1e288a4f22940d235d1c3d5680634f32: Waiting for close lock at 1676300624448Running coprocessor pre-close hooks at 1676300624448Disabling compacts and flushes for region at 1676300624448Disabling writes for close at 1676300624448Writing region close event to WAL at 1676300624456 (+8 ms)Running coprocessor post-close hooks at 1676300624460 (+4 ms)Closed at 1676300624461 (+1 ms) 2023-02-13 15:03:44,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:44,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing fc2a1fd673f2e19effb20f01b21bea03, disabling compactions & flushes 2023-02-13 15:03:44,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:44,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:44,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. after waiting 0 ms 2023-02-13 15:03:44,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:44,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:44,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 896400298655c8a2b00fed5bcd208f1f: Waiting for close lock at 1676300624457Running coprocessor pre-close hooks at 1676300624457Disabling compacts and flushes for region at 1676300624457Disabling writes for close at 1676300624457Writing region close event to WAL at 1676300624458 (+1 ms)Running coprocessor post-close hooks at 1676300624463 (+5 ms)Closed at 1676300624464 (+1 ms) 2023-02-13 15:03:44,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:44,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5929cc1c7b5c57368512e5d14cd0ee1a, disabling compactions & flushes 2023-02-13 15:03:44,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:44,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:44,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. after waiting 0 ms 2023-02-13 15:03:44,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:44,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:44,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for fc2a1fd673f2e19effb20f01b21bea03: Waiting for close lock at 1676300624461Running coprocessor pre-close hooks at 1676300624461Disabling compacts and flushes for region at 1676300624461Disabling writes for close at 1676300624461Writing region close event to WAL at 1676300624463 (+2 ms)Running coprocessor post-close hooks at 1676300624467 (+4 ms)Closed at 1676300624468 (+1 ms) 2023-02-13 15:03:44,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:44,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 075e7e62d8986f2db8d4bf14e7f49cdc, disabling compactions & flushes 2023-02-13 15:03:44,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:44,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:44,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. after waiting 0 ms 2023-02-13 15:03:44,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:44,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:44,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5929cc1c7b5c57368512e5d14cd0ee1a: Waiting for close lock at 1676300624464Running coprocessor pre-close hooks at 1676300624464Disabling compacts and flushes for region at 1676300624464Disabling writes for close at 1676300624464Writing region close event to WAL at 1676300624466 (+2 ms)Running coprocessor post-close hooks at 1676300624471 (+5 ms)Closed at 1676300624472 (+1 ms) 2023-02-13 15:03:44,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:44,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing aa676702bcb180694d8939267a94293f, disabling compactions & flushes 2023-02-13 15:03:44,472 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/.tmp/table/e0001f35b1bc46b1b8ca6aefe21b3658 2023-02-13 15:03:44,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:44,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:44,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. after waiting 0 ms 2023-02-13 15:03:44,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:44,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:44,476 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:44,476 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:44,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:44,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 075e7e62d8986f2db8d4bf14e7f49cdc: Waiting for close lock at 1676300624468Running coprocessor pre-close hooks at 1676300624468Disabling compacts and flushes for region at 1676300624468Disabling writes for close at 1676300624468Writing region close event to WAL at 1676300624470 (+2 ms)Running coprocessor post-close hooks at 1676300624474 (+4 ms)Closed at 1676300624476 (+2 ms) 2023-02-13 15:03:44,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:44,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e18c304667822681dc9348fd5e92d4c1, disabling compactions & flushes 2023-02-13 15:03:44,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:44,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:44,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. after waiting 0 ms 2023-02-13 15:03:44,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:44,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing e18c304667822681dc9348fd5e92d4c1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 15:03:44,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 15:03:44,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:44,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for aa676702bcb180694d8939267a94293f: Waiting for close lock at 1676300624472Running coprocessor pre-close hooks at 1676300624472Disabling compacts and flushes for region at 1676300624472Disabling writes for close at 1676300624472Writing region close event to WAL at 1676300624472Running coprocessor post-close hooks at 1676300624479 (+7 ms)Closed at 1676300624479 2023-02-13 15:03:44,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:44,480 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/.tmp/info/36fecec02f1b42518b80744bef9d5c49 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/info/36fecec02f1b42518b80744bef9d5c49 2023-02-13 15:03:44,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/info/36fecec02f1b42518b80744bef9d5c49, entries=110, sequenceid=32, filesize=18.7 K 2023-02-13 15:03:44,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/.tmp/table/e0001f35b1bc46b1b8ca6aefe21b3658 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/table/e0001f35b1bc46b1b8ca6aefe21b3658 2023-02-13 15:03:44,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/table/e0001f35b1bc46b1b8ca6aefe21b3658, entries=4, sequenceid=32, filesize=4.8 K 2023-02-13 15:03:44,492 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.97 KB/14302, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=32, compaction requested=false 2023-02-13 15:03:44,492 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 15:03:44,501 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-13 15:03:44,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:03:44,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:44,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300624423Running coprocessor pre-close hooks at 1676300624423Disabling compacts and flushes for region at 1676300624423Disabling writes for close at 1676300624423Obtaining lock to block concurrent updates at 1676300624423Preparing flush snapshotting stores in 1588230740 at 1676300624423Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14302, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676300624423Flushing stores of hbase:meta,,1.1588230740 at 1676300624427 (+4 ms)Flushing 1588230740/info: creating writer at 1676300624427Flushing 1588230740/info: appending metadata at 1676300624434 (+7 ms)Flushing 1588230740/info: closing flushed file at 1676300624434Flushing 1588230740/table: creating writer at 1676300624462 (+28 ms)Flushing 1588230740/table: appending metadata at 1676300624465 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676300624465Flushing 1588230740/info: reopening flushed file at 1676300624481 (+16 ms)Flushing 1588230740/table: reopening flushed file at 1676300624486 (+5 ms)Finished flush of dataSize ~13.97 KB/14302, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=32, compaction requested=false at 1676300624492 (+6 ms)Writing region close event to WAL at 1676300624495 (+3 ms)Running coprocessor post-close hooks at 1676300624502 (+7 ms)Closed at 1676300624502 2023-02-13 15:03:44,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:44,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/.tmp/info/3c4d06cb05314adb8fbf3cb5ff3c8d69 2023-02-13 15:03:44,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/.tmp/info/3c4d06cb05314adb8fbf3cb5ff3c8d69 as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/info/3c4d06cb05314adb8fbf3cb5ff3c8d69 2023-02-13 15:03:44,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/info/3c4d06cb05314adb8fbf3cb5ff3c8d69, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 15:03:44,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e18c304667822681dc9348fd5e92d4c1 in 36ms, sequenceid=6, compaction requested=false 2023-02-13 15:03:44,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 15:03:44,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/hbase/namespace/e18c304667822681dc9348fd5e92d4c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 15:03:44,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:44,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e18c304667822681dc9348fd5e92d4c1: Waiting for close lock at 1676300624477Running coprocessor pre-close hooks at 1676300624477Disabling compacts and flushes for region at 1676300624477Disabling writes for close at 1676300624477Obtaining lock to block concurrent updates at 1676300624477Preparing flush snapshotting stores in e18c304667822681dc9348fd5e92d4c1 at 1676300624477Finished memstore snapshotting hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676300624478 (+1 ms)Flushing stores of hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. at 1676300624489 (+11 ms)Flushing e18c304667822681dc9348fd5e92d4c1/info: creating writer at 1676300624489Flushing e18c304667822681dc9348fd5e92d4c1/info: appending metadata at 1676300624493 (+4 ms)Flushing e18c304667822681dc9348fd5e92d4c1/info: closing flushed file at 1676300624493Flushing e18c304667822681dc9348fd5e92d4c1/info: reopening flushed file at 1676300624508 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e18c304667822681dc9348fd5e92d4c1 in 36ms, sequenceid=6, compaction requested=false at 1676300624513 (+5 ms)Writing region close event to WAL at 1676300624514 (+1 ms)Running coprocessor post-close hooks at 1676300624517 (+3 ms)Closed at 1676300624517 2023-02-13 15:03:44,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676300620483.e18c304667822681dc9348fd5e92d4c1. 2023-02-13 15:03:44,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1cf110e0ba97a96edb7093e36a32c37f, disabling compactions & flushes 2023-02-13 15:03:44,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:44,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:44,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. after waiting 0 ms 2023-02-13 15:03:44,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:44,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 15:03:44,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:44,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1cf110e0ba97a96edb7093e36a32c37f: Waiting for close lock at 1676300624517Running coprocessor pre-close hooks at 1676300624517Disabling compacts and flushes for region at 1676300624517Disabling writes for close at 1676300624517Writing region close event to WAL at 1676300624517Running coprocessor post-close hooks at 1676300624521 (+4 ms)Closed at 1676300624521 2023-02-13 15:03:44,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:44,620 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,32935,1676300619701; all regions closed. 2023-02-13 15:03:44,623 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,43261,1676300619749; all regions closed. 2023-02-13 15:03:44,627 DEBUG [RS:0;jenkins-hbase20:32935] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/oldWALs 2023-02-13 15:03:44,627 INFO [RS:0;jenkins-hbase20:32935] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C32935%2C1676300619701:(num 1676300620846) 2023-02-13 15:03:44,627 DEBUG [RS:0;jenkins-hbase20:32935] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:44,627 INFO [RS:0;jenkins-hbase20:32935] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:44,627 INFO [RS:0;jenkins-hbase20:32935] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:44,627 INFO [RS:0;jenkins-hbase20:32935] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:44,627 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:44,627 INFO [RS:0;jenkins-hbase20:32935] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:44,628 INFO [RS:0;jenkins-hbase20:32935] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:44,628 INFO [RS:0;jenkins-hbase20:32935] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:32935 2023-02-13 15:03:44,631 DEBUG [RS:1;jenkins-hbase20:43261] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/oldWALs 2023-02-13 15:03:44,631 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,631 INFO [RS:1;jenkins-hbase20:43261] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43261%2C1676300619749.meta:.meta(num 1676300620369) 2023-02-13 15:03:44,631 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:44,631 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32935,1676300619701 2023-02-13 15:03:44,631 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c52a543 rejected from java.util.concurrent.ThreadPoolExecutor@486d3811[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:44,631 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:44,631 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:44,632 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,32935,1676300619701] 2023-02-13 15:03:44,632 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,32935,1676300619701; numProcessing=1 2023-02-13 15:03:44,634 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,32935,1676300619701 already deleted, retry=false 2023-02-13 15:03:44,634 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,32935,1676300619701 expired; onlineServers=1 2023-02-13 15:03:44,636 DEBUG [RS:1;jenkins-hbase20:43261] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/oldWALs 2023-02-13 15:03:44,636 INFO [RS:1;jenkins-hbase20:43261] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43261%2C1676300619749:(num 1676300621131) 2023-02-13 15:03:44,636 DEBUG [RS:1;jenkins-hbase20:43261] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:44,636 INFO [RS:1;jenkins-hbase20:43261] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:44,637 INFO [RS:1;jenkins-hbase20:43261] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:44,637 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:44,638 INFO [RS:1;jenkins-hbase20:43261] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43261 2023-02-13 15:03:44,639 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43261,1676300619749 2023-02-13 15:03:44,639 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:44,639 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4746c27d rejected from java.util.concurrent.ThreadPoolExecutor@43794e4d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:44,639 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43261,1676300619749] 2023-02-13 15:03:44,639 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43261,1676300619749; numProcessing=2 2023-02-13 15:03:44,640 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43261,1676300619749 already deleted, retry=false 2023-02-13 15:03:44,640 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,43261,1676300619749 expired; onlineServers=0 2023-02-13 15:03:44,640 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44327,1676300619515' ***** 2023-02-13 15:03:44,640 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 15:03:44,641 DEBUG [M:0;jenkins-hbase20:44327] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6768b184, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:44,641 INFO [M:0;jenkins-hbase20:44327] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44327,1676300619515 2023-02-13 15:03:44,641 INFO [M:0;jenkins-hbase20:44327] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44327,1676300619515; all regions closed. 2023-02-13 15:03:44,641 DEBUG [M:0;jenkins-hbase20:44327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:44,641 DEBUG [M:0;jenkins-hbase20:44327] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 15:03:44,641 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 15:03:44,641 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300619975] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300619975,5,FailOnTimeoutGroup] 2023-02-13 15:03:44,642 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:44,641 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300619968] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300619968,5,FailOnTimeoutGroup] 2023-02-13 15:03:44,641 DEBUG [M:0;jenkins-hbase20:44327] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 15:03:44,642 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:44,643 INFO [M:0;jenkins-hbase20:44327] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 15:03:44,643 INFO [M:0;jenkins-hbase20:44327] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 15:03:44,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:44,643 INFO [M:0;jenkins-hbase20:44327] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 15:03:44,643 DEBUG [M:0;jenkins-hbase20:44327] master.HMaster(1502): Stopping service threads 2023-02-13 15:03:44,643 INFO [M:0;jenkins-hbase20:44327] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 15:03:44,643 ERROR [M:0;jenkins-hbase20:44327] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 15:03:44,644 INFO [M:0;jenkins-hbase20:44327] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 15:03:44,644 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 15:03:44,644 DEBUG [M:0;jenkins-hbase20:44327] zookeeper.ZKUtil(398): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 15:03:44,644 WARN [M:0;jenkins-hbase20:44327] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 15:03:44,644 INFO [M:0;jenkins-hbase20:44327] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 15:03:44,644 INFO [M:0;jenkins-hbase20:44327] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 15:03:44,644 DEBUG [M:0;jenkins-hbase20:44327] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:44,644 INFO [M:0;jenkins-hbase20:44327] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:44,644 DEBUG [M:0;jenkins-hbase20:44327] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:44,644 DEBUG [M:0;jenkins-hbase20:44327] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:44,644 DEBUG [M:0;jenkins-hbase20:44327] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:44,645 INFO [M:0;jenkins-hbase20:44327] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=101.12 KB heapSize=120.84 KB 2023-02-13 15:03:44,653 INFO [M:0;jenkins-hbase20:44327] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=101.12 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fd970835a1624f269983c5ac2331e80d 2023-02-13 15:03:44,658 DEBUG [M:0;jenkins-hbase20:44327] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fd970835a1624f269983c5ac2331e80d as hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fd970835a1624f269983c5ac2331e80d 2023-02-13 15:03:44,663 INFO [M:0;jenkins-hbase20:44327] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41523/user/jenkins/test-data/7ef2b2c6-87ec-27cf-1a52-39c531a5a87a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fd970835a1624f269983c5ac2331e80d, entries=31, sequenceid=218, filesize=9.0 K 2023-02-13 15:03:44,663 INFO [M:0;jenkins-hbase20:44327] regionserver.HRegion(2947): Finished flush of dataSize ~101.12 KB/103547, heapSize ~120.82 KB/123720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=218, compaction requested=false 2023-02-13 15:03:44,664 INFO [M:0;jenkins-hbase20:44327] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:44,664 DEBUG [M:0;jenkins-hbase20:44327] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300624644Disabling compacts and flushes for region at 1676300624644Disabling writes for close at 1676300624644Obtaining lock to block concurrent updates at 1676300624645 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676300624645Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103547, getHeapSize=123720, getOffHeapSize=0, getCellsCount=263 at 1676300624645Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676300624646 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676300624646Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676300624648 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676300624648Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676300624659 (+11 ms)Finished flush of dataSize ~101.12 KB/103547, heapSize ~120.82 KB/123720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=218, compaction requested=false at 1676300624663 (+4 ms)Writing region close event to WAL at 1676300624664 (+1 ms)Closed at 1676300624664 2023-02-13 15:03:44,668 INFO [M:0;jenkins-hbase20:44327] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 15:03:44,668 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:44,668 INFO [M:0;jenkins-hbase20:44327] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44327 2023-02-13 15:03:44,671 DEBUG [M:0;jenkins-hbase20:44327] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44327,1676300619515 already deleted, retry=false 2023-02-13 15:03:44,926 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:44,926 INFO [M:0;jenkins-hbase20:44327] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44327,1676300619515; zookeeper connection closed. 2023-02-13 15:03:44,926 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f196947 rejected from java.util.concurrent.ThreadPoolExecutor@2b26f87c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:44,927 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): master:44327-0x1015c5d50830000, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:44,927 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3bb7cb47 rejected from java.util.concurrent.ThreadPoolExecutor@2b26f87c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:45,026 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:45,026 INFO [RS:1;jenkins-hbase20:43261] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,43261,1676300619749; zookeeper connection closed. 2023-02-13 15:03:45,026 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4613ad79 rejected from java.util.concurrent.ThreadPoolExecutor@43794e4d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:45,026 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b3288aa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b3288aa 2023-02-13 15:03:45,026 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:43261-0x1015c5d50830002, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:45,026 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3eb5f161 rejected from java.util.concurrent.ThreadPoolExecutor@43794e4d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:45,126 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:45,126 INFO [RS:0;jenkins-hbase20:32935] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,32935,1676300619701; zookeeper connection closed. 2023-02-13 15:03:45,126 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6589ebef rejected from java.util.concurrent.ThreadPoolExecutor@486d3811[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:45,127 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5e0de085] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5e0de085 2023-02-13 15:03:45,127 DEBUG [Listener at localhost.localdomain/40345-EventThread] zookeeper.ZKWatcher(600): regionserver:32935-0x1015c5d50830001, quorum=127.0.0.1:52423, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:45,127 INFO [Listener at localhost.localdomain/40345] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 15:03:45,127 ERROR [Listener at localhost.localdomain/40345-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1da43894 rejected from java.util.concurrent.ThreadPoolExecutor@486d3811[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:45,200 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop-7406859854460538922.jar 2023-02-13 15:03:45,204 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676300622447 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:45,205 DEBUG [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce 2023-02-13 15:03:45,205 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:45,205 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:45,205 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(239): region to add: aa676702bcb180694d8939267a94293f 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=81790214badbeb2b84fbf777b424492a as 81790214badbeb2b84fbf777b424492a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=1e288a4f22940d235d1c3d5680634f32 as 1e288a4f22940d235d1c3d5680634f32 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=075e7e62d8986f2db8d4bf14e7f49cdc as 075e7e62d8986f2db8d4bf14e7f49cdc in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=3e7b613215d42c7bacf205bef8677c14 as 3e7b613215d42c7bacf205bef8677c14 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=fc2a1fd673f2e19effb20f01b21bea03 as fc2a1fd673f2e19effb20f01b21bea03 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=23b3c280fb8fa33685d17b7e59c9c23b as 23b3c280fb8fa33685d17b7e59c9c23b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=896400298655c8a2b00fed5bcd208f1f as 896400298655c8a2b00fed5bcd208f1f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=1cf110e0ba97a96edb7093e36a32c37f as 1cf110e0ba97a96edb7093e36a32c37f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,206 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=5929cc1c7b5c57368512e5d14cd0ee1a as 5929cc1c7b5c57368512e5d14cd0ee1a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,207 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(585): clone region=aa676702bcb180694d8939267a94293f as aa676702bcb180694d8939267a94293f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 15:03:45,208 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 075e7e62d8986f2db8d4bf14e7f49cdc, NAME => 'testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,208 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1e288a4f22940d235d1c3d5680634f32, NAME => 'testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,208 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 81790214badbeb2b84fbf777b424492a, NAME => 'testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,208 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3e7b613215d42c7bacf205bef8677c14, NAME => 'testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,209 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => fc2a1fd673f2e19effb20f01b21bea03, NAME => 'testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,211 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 1cf110e0ba97a96edb7093e36a32c37f, NAME => 'testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,211 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 23b3c280fb8fa33685d17b7e59c9c23b, NAME => 'testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,211 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 896400298655c8a2b00fed5bcd208f1f, NAME => 'testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,235 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,235 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,235 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0443ccfc16a0481aae4c818372e7b7a5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,235 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c4c5a2d2edf445dd967482ac365e753e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,239 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,239 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5525d9f5ca0b45a198536b74e352c678 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,243 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4f10a34085fc40ae966b98520f74a84f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,244 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,244 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7c3fded42775464ba8309d9198f2f86e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,244 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 791dafff5f784891af4a763e6c6b269f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,245 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,246 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6832c16c17d2479fb73b85a46139b011 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,246 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b566d7a8756405da62e31e45a7d8b27 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,247 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,247 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8a2f2badb7fa4dafb93be475c681db54 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,247 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 075e7e62d8986f2db8d4bf14e7f49cdc, disabling compactions & flushes 2023-02-13 15:03:45,247 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,247 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,247 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. after waiting 0 ms 2023-02-13 15:03:45,247 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,248 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,248 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 075e7e62d8986f2db8d4bf14e7f49cdc: Waiting for close lock at 1676300625247Disabling compacts and flushes for region at 1676300625247Disabling writes for close at 1676300625247Writing region close event to WAL at 1676300625247Closed at 1676300625248 (+1 ms) 2023-02-13 15:03:45,248 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5929cc1c7b5c57368512e5d14cd0ee1a, NAME => 'testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,250 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eca5a33809c04283b9d6e196d47802c5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,251 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 091d184bb2a14b86a881e38bdfc182ad from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 1cf110e0ba97a96edb7093e36a32c37f, disabling compactions & flushes 2023-02-13 15:03:45,251 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. after waiting 0 ms 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,251 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 81790214badbeb2b84fbf777b424492a, disabling compactions & flushes 2023-02-13 15:03:45,251 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:45,252 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. after waiting 0 ms 2023-02-13 15:03:45,252 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:45,252 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:45,252 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 81790214badbeb2b84fbf777b424492a: Waiting for close lock at 1676300625251Disabling compacts and flushes for region at 1676300625251Disabling writes for close at 1676300625252 (+1 ms)Writing region close event to WAL at 1676300625252Closed at 1676300625252 2023-02-13 15:03:45,251 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 1cf110e0ba97a96edb7093e36a32c37f: Waiting for close lock at 1676300625251Disabling compacts and flushes for region at 1676300625251Disabling writes for close at 1676300625251Writing region close event to WAL at 1676300625251Closed at 1676300625251 2023-02-13 15:03:45,252 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 587b3d6041fb40eca8c80b30d22861f8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,252 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa676702bcb180694d8939267a94293f, NAME => 'testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,255 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a595a093aa7743d99df958b3c9d31547 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,255 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing fc2a1fd673f2e19effb20f01b21bea03, disabling compactions & flushes 2023-02-13 15:03:45,255 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,255 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,255 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. after waiting 0 ms 2023-02-13 15:03:45,255 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,255 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,255 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for fc2a1fd673f2e19effb20f01b21bea03: Waiting for close lock at 1676300625255Disabling compacts and flushes for region at 1676300625255Disabling writes for close at 1676300625255Writing region close event to WAL at 1676300625255Closed at 1676300625255 2023-02-13 15:03:45,259 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 14e7a8492cc1475c88fc563f6cf25bb8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,259 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 1e288a4f22940d235d1c3d5680634f32, disabling compactions & flushes 2023-02-13 15:03:45,259 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,259 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,259 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. after waiting 0 ms 2023-02-13 15:03:45,259 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,259 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,259 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 1e288a4f22940d235d1c3d5680634f32: Waiting for close lock at 1676300625259Disabling compacts and flushes for region at 1676300625259Disabling writes for close at 1676300625259Writing region close event to WAL at 1676300625259Closed at 1676300625259 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 23b3c280fb8fa33685d17b7e59c9c23b, disabling compactions & flushes 2023-02-13 15:03:45,260 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. after waiting 0 ms 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,260 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 23b3c280fb8fa33685d17b7e59c9c23b: Waiting for close lock at 1676300625260Disabling compacts and flushes for region at 1676300625260Disabling writes for close at 1676300625260Writing region close event to WAL at 1676300625260Closed at 1676300625260 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 896400298655c8a2b00fed5bcd208f1f, disabling compactions & flushes 2023-02-13 15:03:45,260 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. after waiting 0 ms 2023-02-13 15:03:45,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,261 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,261 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 896400298655c8a2b00fed5bcd208f1f: Waiting for close lock at 1676300625260Disabling compacts and flushes for region at 1676300625260Disabling writes for close at 1676300625260Writing region close event to WAL at 1676300625261 (+1 ms)Closed at 1676300625261 2023-02-13 15:03:45,262 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3e7b613215d42c7bacf205bef8677c14, disabling compactions & flushes 2023-02-13 15:03:45,262 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,262 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,262 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. after waiting 0 ms 2023-02-13 15:03:45,262 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,262 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,262 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3e7b613215d42c7bacf205bef8677c14: Waiting for close lock at 1676300625262Disabling compacts and flushes for region at 1676300625262Disabling writes for close at 1676300625262Writing region close event to WAL at 1676300625262Closed at 1676300625262 2023-02-13 15:03:45,264 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,264 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing aa676702bcb180694d8939267a94293f, disabling compactions & flushes 2023-02-13 15:03:45,264 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:45,264 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:45,264 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. after waiting 0 ms 2023-02-13 15:03:45,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:45,265 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:45,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for aa676702bcb180694d8939267a94293f: Waiting for close lock at 1676300625264Disabling compacts and flushes for region at 1676300625264Disabling writes for close at 1676300625265 (+1 ms)Writing region close event to WAL at 1676300625265Closed at 1676300625265 2023-02-13 15:03:45,270 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,270 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 57941c5481ca44a7afdf7e3541842288 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,272 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d0646e0b54544584a7edb241bd9cdbcf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 15:03:45,274 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 5929cc1c7b5c57368512e5d14cd0ee1a, disabling compactions & flushes 2023-02-13 15:03:45,274 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:45,274 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:45,274 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. after waiting 0 ms 2023-02-13 15:03:45,274 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:45,274 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:45,274 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 5929cc1c7b5c57368512e5d14cd0ee1a: Waiting for close lock at 1676300625274Disabling compacts and flushes for region at 1676300625274Disabling writes for close at 1676300625274Writing region close event to WAL at 1676300625274Closed at 1676300625274 2023-02-13 15:03:45,275 INFO [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676300622447 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:45,275 DEBUG [Listener at localhost.localdomain/40345] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,275 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a 2023-02-13 15:03:45,275 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-data/ 2023-02-13 15:03:45,276 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----default/ 2023-02-13 15:03:45,276 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 15:03:45,277 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------075e7e62d8986f2db8d4bf14e7f49cdc/ 2023-02-13 15:03:45,278 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,278 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,278 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=075e7e62d8986f2db8d4bf14e7f49cdc-0443ccfc16a0481aae4c818372e7b7a5 2023-02-13 15:03:45,278 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,280 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=075e7e62d8986f2db8d4bf14e7f49cdc-4f10a34085fc40ae966b98520f74a84f 2023-02-13 15:03:45,280 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------1cf110e0ba97a96edb7093e36a32c37f/ 2023-02-13 15:03:45,280 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,280 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------1e288a4f22940d235d1c3d5680634f32/ 2023-02-13 15:03:45,281 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,281 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,281 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=1e288a4f22940d235d1c3d5680634f32-791dafff5f784891af4a763e6c6b269f 2023-02-13 15:03:45,282 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,282 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=1e288a4f22940d235d1c3d5680634f32-eca5a33809c04283b9d6e196d47802c5 2023-02-13 15:03:45,282 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------23b3c280fb8fa33685d17b7e59c9c23b/ 2023-02-13 15:03:45,282 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,282 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,283 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=23b3c280fb8fa33685d17b7e59c9c23b-8a2f2badb7fa4dafb93be475c681db54 2023-02-13 15:03:45,283 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,283 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=23b3c280fb8fa33685d17b7e59c9c23b-587b3d6041fb40eca8c80b30d22861f8 2023-02-13 15:03:45,283 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------3e7b613215d42c7bacf205bef8677c14/ 2023-02-13 15:03:45,284 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,284 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,284 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=3e7b613215d42c7bacf205bef8677c14-091d184bb2a14b86a881e38bdfc182ad 2023-02-13 15:03:45,284 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,284 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=3e7b613215d42c7bacf205bef8677c14-14e7a8492cc1475c88fc563f6cf25bb8 2023-02-13 15:03:45,285 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------5929cc1c7b5c57368512e5d14cd0ee1a/ 2023-02-13 15:03:45,285 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,285 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,285 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=5929cc1c7b5c57368512e5d14cd0ee1a-57941c5481ca44a7afdf7e3541842288 2023-02-13 15:03:45,285 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,286 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=5929cc1c7b5c57368512e5d14cd0ee1a-d0646e0b54544584a7edb241bd9cdbcf 2023-02-13 15:03:45,286 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------81790214badbeb2b84fbf777b424492a/ 2023-02-13 15:03:45,286 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,286 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,287 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=81790214badbeb2b84fbf777b424492a-5525d9f5ca0b45a198536b74e352c678 2023-02-13 15:03:45,287 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,287 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=81790214badbeb2b84fbf777b424492a-7c3fded42775464ba8309d9198f2f86e 2023-02-13 15:03:45,287 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------896400298655c8a2b00fed5bcd208f1f/ 2023-02-13 15:03:45,288 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,288 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,288 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=896400298655c8a2b00fed5bcd208f1f-6832c16c17d2479fb73b85a46139b011 2023-02-13 15:03:45,288 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,288 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=896400298655c8a2b00fed5bcd208f1f-a595a093aa7743d99df958b3c9d31547 2023-02-13 15:03:45,289 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------aa676702bcb180694d8939267a94293f/ 2023-02-13 15:03:45,289 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,289 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |----------fc2a1fd673f2e19effb20f01b21bea03/ 2023-02-13 15:03:45,289 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:45,289 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:45,290 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=fc2a1fd673f2e19effb20f01b21bea03-c4c5a2d2edf445dd967482ac365e753e 2023-02-13 15:03:45,290 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:45,290 DEBUG [Listener at localhost.localdomain/40345] util.CommonFSUtils(702): |----------------testWithMapReduce=fc2a1fd673f2e19effb20f01b21bea03-1b566d7a8756405da62e31e45a7d8b27 2023-02-13 15:03:45,290 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,291 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,291 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,291 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,292 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,292 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,292 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,348 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop-6436807290542203010.jar 2023-02-13 15:03:45,349 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,349 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,349 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,350 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,350 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,350 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,350 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 15:03:45,351 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 15:03:45,351 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 15:03:45,351 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 15:03:45,352 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 15:03:45,352 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 15:03:45,352 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 15:03:45,353 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 15:03:45,353 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 15:03:45,353 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 15:03:45,354 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 15:03:45,354 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:03:45,354 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:03:45,354 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:03:45,355 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 15:03:45,410 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop-3814640122836074845.jar 2023-02-13 15:03:45,411 DEBUG [Listener at localhost.localdomain/40345] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 15:03:45,415 WARN [Listener at localhost.localdomain/40345] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 15:03:45,439 INFO [Listener at localhost.localdomain/40345] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 15:03:45,564 WARN [Listener at localhost.localdomain/40345] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/mapreduce.cluster.local.dir/1676300625528/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 15:03:45,565 WARN [Listener at localhost.localdomain/40345] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/mapreduce.cluster.local.dir/1676300625528/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 15:03:45,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,616 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,617 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,619 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:45,621 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1 2023-02-13 15:03:45,621 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 075e7e62d8986f2db8d4bf14e7f49cdc columnFamilyName f1 2023-02-13 15:03:45,627 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f1/testWithMapReduce=075e7e62d8986f2db8d4bf14e7f49cdc-0443ccfc16a0481aae4c818372e7b7a5 2023-02-13 15:03:45,627 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(310): Store=075e7e62d8986f2db8d4bf14e7f49cdc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,628 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 075e7e62d8986f2db8d4bf14e7f49cdc 2023-02-13 15:03:45,629 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2 2023-02-13 15:03:45,629 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 075e7e62d8986f2db8d4bf14e7f49cdc columnFamilyName f2 2023-02-13 15:03:45,634 DEBUG [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/075e7e62d8986f2db8d4bf14e7f49cdc/f2/testWithMapReduce=075e7e62d8986f2db8d4bf14e7f49cdc-4f10a34085fc40ae966b98520f74a84f 2023-02-13 15:03:45,634 INFO [StoreOpener-075e7e62d8986f2db8d4bf14e7f49cdc-1] regionserver.HStore(310): Store=075e7e62d8986f2db8d4bf14e7f49cdc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:45,635 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 075e7e62d8986f2db8d4bf14e7f49cdc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59167855, jitterRate=-0.11833025515079498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:45,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 075e7e62d8986f2db8d4bf14e7f49cdc: Writing region info on filesystem at 1676300625617Initializing all the Stores at 1676300625618 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625618Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625618Region opened successfully at 1676300625635 (+17 ms) 2023-02-13 15:03:45,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 075e7e62d8986f2db8d4bf14e7f49cdc, disabling compactions & flushes 2023-02-13 15:03:45,665 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. after waiting 0 ms 2023-02-13 15:03:45,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676300621114.075e7e62d8986f2db8d4bf14e7f49cdc. 2023-02-13 15:03:45,667 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 075e7e62d8986f2db8d4bf14e7f49cdc: Waiting for close lock at 1676300625665Disabling compacts and flushes for region at 1676300625665Disabling writes for close at 1676300625666 (+1 ms)Writing region close event to WAL at 1676300625666Closed at 1676300625666 2023-02-13 15:03:45,670 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,670 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,671 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,673 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:45,675 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1 2023-02-13 15:03:45,675 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 896400298655c8a2b00fed5bcd208f1f columnFamilyName f1 2023-02-13 15:03:45,680 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f1/testWithMapReduce=896400298655c8a2b00fed5bcd208f1f-6832c16c17d2479fb73b85a46139b011 2023-02-13 15:03:45,680 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(310): Store=896400298655c8a2b00fed5bcd208f1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,680 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 896400298655c8a2b00fed5bcd208f1f 2023-02-13 15:03:45,681 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2 2023-02-13 15:03:45,681 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 896400298655c8a2b00fed5bcd208f1f columnFamilyName f2 2023-02-13 15:03:45,686 DEBUG [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/896400298655c8a2b00fed5bcd208f1f/f2/testWithMapReduce=896400298655c8a2b00fed5bcd208f1f-a595a093aa7743d99df958b3c9d31547 2023-02-13 15:03:45,686 INFO [StoreOpener-896400298655c8a2b00fed5bcd208f1f-1] regionserver.HStore(310): Store=896400298655c8a2b00fed5bcd208f1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:45,687 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 896400298655c8a2b00fed5bcd208f1f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70977920, jitterRate=0.05765342712402344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:45,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 896400298655c8a2b00fed5bcd208f1f: Writing region info on filesystem at 1676300625672Initializing all the Stores at 1676300625673 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625673Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625673Region opened successfully at 1676300625687 (+14 ms) 2023-02-13 15:03:45,713 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 896400298655c8a2b00fed5bcd208f1f, disabling compactions & flushes 2023-02-13 15:03:45,714 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,714 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,714 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. after waiting 0 ms 2023-02-13 15:03:45,714 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,715 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676300621114.896400298655c8a2b00fed5bcd208f1f. 2023-02-13 15:03:45,715 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 896400298655c8a2b00fed5bcd208f1f: Waiting for close lock at 1676300625713Disabling compacts and flushes for region at 1676300625713Disabling writes for close at 1676300625714 (+1 ms)Writing region close event to WAL at 1676300625714Closed at 1676300625715 (+1 ms) 2023-02-13 15:03:45,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,719 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,721 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,725 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:45,727 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1 2023-02-13 15:03:45,727 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23b3c280fb8fa33685d17b7e59c9c23b columnFamilyName f1 2023-02-13 15:03:45,732 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f1/testWithMapReduce=23b3c280fb8fa33685d17b7e59c9c23b-8a2f2badb7fa4dafb93be475c681db54 2023-02-13 15:03:45,732 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(310): Store=23b3c280fb8fa33685d17b7e59c9c23b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,733 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 23b3c280fb8fa33685d17b7e59c9c23b 2023-02-13 15:03:45,734 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2 2023-02-13 15:03:45,734 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23b3c280fb8fa33685d17b7e59c9c23b columnFamilyName f2 2023-02-13 15:03:45,740 DEBUG [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/23b3c280fb8fa33685d17b7e59c9c23b/f2/testWithMapReduce=23b3c280fb8fa33685d17b7e59c9c23b-587b3d6041fb40eca8c80b30d22861f8 2023-02-13 15:03:45,740 INFO [StoreOpener-23b3c280fb8fa33685d17b7e59c9c23b-1] regionserver.HStore(310): Store=23b3c280fb8fa33685d17b7e59c9c23b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,740 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:45,740 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 23b3c280fb8fa33685d17b7e59c9c23b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75234931, jitterRate=0.12108783423900604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:45,740 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 23b3c280fb8fa33685d17b7e59c9c23b: Writing region info on filesystem at 1676300625721Initializing all the Stores at 1676300625722 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625722Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625725 (+3 ms)Region opened successfully at 1676300625740 (+15 ms) 2023-02-13 15:03:45,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 23b3c280fb8fa33685d17b7e59c9c23b, disabling compactions & flushes 2023-02-13 15:03:45,830 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. after waiting 0 ms 2023-02-13 15:03:45,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,830 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676300621114.23b3c280fb8fa33685d17b7e59c9c23b. 2023-02-13 15:03:45,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 23b3c280fb8fa33685d17b7e59c9c23b: Waiting for close lock at 1676300625830Disabling compacts and flushes for region at 1676300625830Disabling writes for close at 1676300625830Writing region close event to WAL at 1676300625830Closed at 1676300625830 2023-02-13 15:03:45,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,834 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,835 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,837 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:45,838 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1 2023-02-13 15:03:45,839 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e7b613215d42c7bacf205bef8677c14 columnFamilyName f1 2023-02-13 15:03:45,843 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f1/testWithMapReduce=3e7b613215d42c7bacf205bef8677c14-091d184bb2a14b86a881e38bdfc182ad 2023-02-13 15:03:45,843 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(310): Store=3e7b613215d42c7bacf205bef8677c14/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,843 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e7b613215d42c7bacf205bef8677c14 2023-02-13 15:03:45,845 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2 2023-02-13 15:03:45,845 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e7b613215d42c7bacf205bef8677c14 columnFamilyName f2 2023-02-13 15:03:45,852 DEBUG [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/3e7b613215d42c7bacf205bef8677c14/f2/testWithMapReduce=3e7b613215d42c7bacf205bef8677c14-14e7a8492cc1475c88fc563f6cf25bb8 2023-02-13 15:03:45,852 INFO [StoreOpener-3e7b613215d42c7bacf205bef8677c14-1] regionserver.HStore(310): Store=3e7b613215d42c7bacf205bef8677c14/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:45,853 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3e7b613215d42c7bacf205bef8677c14; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72818811, jitterRate=0.08508484065532684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:45,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3e7b613215d42c7bacf205bef8677c14: Writing region info on filesystem at 1676300625835Initializing all the Stores at 1676300625836 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625836Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625836Region opened successfully at 1676300625853 (+17 ms) 2023-02-13 15:03:45,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3e7b613215d42c7bacf205bef8677c14, disabling compactions & flushes 2023-02-13 15:03:45,873 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. after waiting 0 ms 2023-02-13 15:03:45,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,874 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676300621114.3e7b613215d42c7bacf205bef8677c14. 2023-02-13 15:03:45,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3e7b613215d42c7bacf205bef8677c14: Waiting for close lock at 1676300625873Disabling compacts and flushes for region at 1676300625873Disabling writes for close at 1676300625873Writing region close event to WAL at 1676300625874 (+1 ms)Closed at 1676300625874 2023-02-13 15:03:45,879 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,879 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,880 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,882 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:45,883 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1 2023-02-13 15:03:45,883 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc2a1fd673f2e19effb20f01b21bea03 columnFamilyName f1 2023-02-13 15:03:45,888 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f1/testWithMapReduce=fc2a1fd673f2e19effb20f01b21bea03-c4c5a2d2edf445dd967482ac365e753e 2023-02-13 15:03:45,888 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(310): Store=fc2a1fd673f2e19effb20f01b21bea03/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,888 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc2a1fd673f2e19effb20f01b21bea03 2023-02-13 15:03:45,890 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2 2023-02-13 15:03:45,890 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc2a1fd673f2e19effb20f01b21bea03 columnFamilyName f2 2023-02-13 15:03:45,895 DEBUG [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/fc2a1fd673f2e19effb20f01b21bea03/f2/testWithMapReduce=fc2a1fd673f2e19effb20f01b21bea03-1b566d7a8756405da62e31e45a7d8b27 2023-02-13 15:03:45,895 INFO [StoreOpener-fc2a1fd673f2e19effb20f01b21bea03-1] regionserver.HStore(310): Store=fc2a1fd673f2e19effb20f01b21bea03/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:45,895 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fc2a1fd673f2e19effb20f01b21bea03; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72143182, jitterRate=0.07501718401908875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:45,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fc2a1fd673f2e19effb20f01b21bea03: Writing region info on filesystem at 1676300625880Initializing all the Stores at 1676300625881 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625881Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625881Region opened successfully at 1676300625895 (+14 ms) 2023-02-13 15:03:45,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fc2a1fd673f2e19effb20f01b21bea03, disabling compactions & flushes 2023-02-13 15:03:45,914 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. after waiting 0 ms 2023-02-13 15:03:45,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,915 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676300621114.fc2a1fd673f2e19effb20f01b21bea03. 2023-02-13 15:03:45,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fc2a1fd673f2e19effb20f01b21bea03: Waiting for close lock at 1676300625914Disabling compacts and flushes for region at 1676300625914Disabling writes for close at 1676300625915 (+1 ms)Writing region close event to WAL at 1676300625915Closed at 1676300625915 2023-02-13 15:03:45,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,920 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,925 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,927 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:45,928 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1 2023-02-13 15:03:45,928 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e288a4f22940d235d1c3d5680634f32 columnFamilyName f1 2023-02-13 15:03:45,933 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f1/testWithMapReduce=1e288a4f22940d235d1c3d5680634f32-791dafff5f784891af4a763e6c6b269f 2023-02-13 15:03:45,933 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(310): Store=1e288a4f22940d235d1c3d5680634f32/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,934 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e288a4f22940d235d1c3d5680634f32 2023-02-13 15:03:45,935 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2 2023-02-13 15:03:45,935 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e288a4f22940d235d1c3d5680634f32 columnFamilyName f2 2023-02-13 15:03:45,941 DEBUG [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/1e288a4f22940d235d1c3d5680634f32/f2/testWithMapReduce=1e288a4f22940d235d1c3d5680634f32-eca5a33809c04283b9d6e196d47802c5 2023-02-13 15:03:45,941 INFO [StoreOpener-1e288a4f22940d235d1c3d5680634f32-1] regionserver.HStore(310): Store=1e288a4f22940d235d1c3d5680634f32/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:45,941 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1e288a4f22940d235d1c3d5680634f32; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70198439, jitterRate=0.04603825509548187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:45,942 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1e288a4f22940d235d1c3d5680634f32: Writing region info on filesystem at 1676300625925Initializing all the Stores at 1676300625926 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625926Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625926Region opened successfully at 1676300625942 (+16 ms) 2023-02-13 15:03:45,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1e288a4f22940d235d1c3d5680634f32, disabling compactions & flushes 2023-02-13 15:03:45,969 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. after waiting 0 ms 2023-02-13 15:03:45,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,969 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676300621114.1e288a4f22940d235d1c3d5680634f32. 2023-02-13 15:03:45,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1e288a4f22940d235d1c3d5680634f32: Waiting for close lock at 1676300625969Disabling compacts and flushes for region at 1676300625969Disabling writes for close at 1676300625969Writing region close event to WAL at 1676300625969Closed at 1676300625969 2023-02-13 15:03:45,973 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,973 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,974 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,976 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:45,977 DEBUG [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/f1 2023-02-13 15:03:45,978 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cf110e0ba97a96edb7093e36a32c37f columnFamilyName f1 2023-02-13 15:03:45,978 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(310): Store=1cf110e0ba97a96edb7093e36a32c37f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,979 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1cf110e0ba97a96edb7093e36a32c37f 2023-02-13 15:03:45,980 DEBUG [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/1cf110e0ba97a96edb7093e36a32c37f/f2 2023-02-13 15:03:45,980 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cf110e0ba97a96edb7093e36a32c37f columnFamilyName f2 2023-02-13 15:03:45,981 INFO [StoreOpener-1cf110e0ba97a96edb7093e36a32c37f-1] regionserver.HStore(310): Store=1cf110e0ba97a96edb7093e36a32c37f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:45,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:45,981 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1cf110e0ba97a96edb7093e36a32c37f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64166199, jitterRate=-0.04384912550449371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:45,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1cf110e0ba97a96edb7093e36a32c37f: Writing region info on filesystem at 1676300625974Initializing all the Stores at 1676300625975 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625975Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625975Region opened successfully at 1676300625981 (+6 ms) 2023-02-13 15:03:45,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1cf110e0ba97a96edb7093e36a32c37f, disabling compactions & flushes 2023-02-13 15:03:45,990 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. after waiting 0 ms 2023-02-13 15:03:45,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,991 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300621114.1cf110e0ba97a96edb7093e36a32c37f. 2023-02-13 15:03:45,991 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1cf110e0ba97a96edb7093e36a32c37f: Waiting for close lock at 1676300625990Disabling compacts and flushes for region at 1676300625990Disabling writes for close at 1676300625990Writing region close event to WAL at 1676300625991 (+1 ms)Closed at 1676300625991 2023-02-13 15:03:45,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:45,994 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:45,995 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:45,999 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa676702bcb180694d8939267a94293f 2023-02-13 15:03:46,001 DEBUG [StoreOpener-aa676702bcb180694d8939267a94293f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/f1 2023-02-13 15:03:46,002 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa676702bcb180694d8939267a94293f columnFamilyName f1 2023-02-13 15:03:46,002 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(310): Store=aa676702bcb180694d8939267a94293f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:46,002 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa676702bcb180694d8939267a94293f 2023-02-13 15:03:46,004 DEBUG [StoreOpener-aa676702bcb180694d8939267a94293f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/aa676702bcb180694d8939267a94293f/f2 2023-02-13 15:03:46,004 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa676702bcb180694d8939267a94293f columnFamilyName f2 2023-02-13 15:03:46,005 INFO [StoreOpener-aa676702bcb180694d8939267a94293f-1] regionserver.HStore(310): Store=aa676702bcb180694d8939267a94293f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:46,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:46,005 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened aa676702bcb180694d8939267a94293f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59440040, jitterRate=-0.11427438259124756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:46,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for aa676702bcb180694d8939267a94293f: Writing region info on filesystem at 1676300625995Initializing all the Stores at 1676300625996 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625996Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300625999 (+3 ms)Region opened successfully at 1676300626005 (+6 ms) 2023-02-13 15:03:46,014 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing aa676702bcb180694d8939267a94293f, disabling compactions & flushes 2023-02-13 15:03:46,015 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:46,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:46,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. after waiting 0 ms 2023-02-13 15:03:46,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:46,015 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676300621114.aa676702bcb180694d8939267a94293f. 2023-02-13 15:03:46,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for aa676702bcb180694d8939267a94293f: Waiting for close lock at 1676300626014Disabling compacts and flushes for region at 1676300626014Disabling writes for close at 1676300626015 (+1 ms)Writing region close event to WAL at 1676300626015Closed at 1676300626015 2023-02-13 15:03:46,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:46,019 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:46,020 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:46,022 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:46,023 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1 2023-02-13 15:03:46,024 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5929cc1c7b5c57368512e5d14cd0ee1a columnFamilyName f1 2023-02-13 15:03:46,029 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f1/testWithMapReduce=5929cc1c7b5c57368512e5d14cd0ee1a-57941c5481ca44a7afdf7e3541842288 2023-02-13 15:03:46,029 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(310): Store=5929cc1c7b5c57368512e5d14cd0ee1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:46,029 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5929cc1c7b5c57368512e5d14cd0ee1a 2023-02-13 15:03:46,030 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2 2023-02-13 15:03:46,031 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5929cc1c7b5c57368512e5d14cd0ee1a columnFamilyName f2 2023-02-13 15:03:46,039 DEBUG [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/5929cc1c7b5c57368512e5d14cd0ee1a/f2/testWithMapReduce=5929cc1c7b5c57368512e5d14cd0ee1a-d0646e0b54544584a7edb241bd9cdbcf 2023-02-13 15:03:46,039 INFO [StoreOpener-5929cc1c7b5c57368512e5d14cd0ee1a-1] regionserver.HStore(310): Store=5929cc1c7b5c57368512e5d14cd0ee1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:46,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:46,039 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5929cc1c7b5c57368512e5d14cd0ee1a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70206927, jitterRate=0.04616473615169525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:46,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5929cc1c7b5c57368512e5d14cd0ee1a: Writing region info on filesystem at 1676300626020Initializing all the Stores at 1676300626021 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300626021Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300626021Region opened successfully at 1676300626039 (+18 ms) 2023-02-13 15:03:46,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5929cc1c7b5c57368512e5d14cd0ee1a, disabling compactions & flushes 2023-02-13 15:03:46,072 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:46,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:46,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. after waiting 0 ms 2023-02-13 15:03:46,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:46,073 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676300621114.5929cc1c7b5c57368512e5d14cd0ee1a. 2023-02-13 15:03:46,073 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5929cc1c7b5c57368512e5d14cd0ee1a: Waiting for close lock at 1676300626072Disabling compacts and flushes for region at 1676300626072Disabling writes for close at 1676300626072Writing region close event to WAL at 1676300626073 (+1 ms)Closed at 1676300626073 2023-02-13 15:03:46,075 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:46,076 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:46,077 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:46,079 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:46,080 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1 2023-02-13 15:03:46,081 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81790214badbeb2b84fbf777b424492a columnFamilyName f1 2023-02-13 15:03:46,085 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f1/testWithMapReduce=81790214badbeb2b84fbf777b424492a-5525d9f5ca0b45a198536b74e352c678 2023-02-13 15:03:46,085 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(310): Store=81790214badbeb2b84fbf777b424492a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:46,085 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81790214badbeb2b84fbf777b424492a 2023-02-13 15:03:46,086 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2 2023-02-13 15:03:46,087 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81790214badbeb2b84fbf777b424492a columnFamilyName f2 2023-02-13 15:03:46,091 DEBUG [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41523/user/jenkins/test-data/22c631ba-f35c-be99-e09b-7b54819ba8cb/testWithMapReduceAndOfflineHBaseMultiRegion/0c715bd4-50be-4d70-99e8-a12f72dceb8a/data/default/testWithMapReduce/81790214badbeb2b84fbf777b424492a/f2/testWithMapReduce=81790214badbeb2b84fbf777b424492a-7c3fded42775464ba8309d9198f2f86e 2023-02-13 15:03:46,091 INFO [StoreOpener-81790214badbeb2b84fbf777b424492a-1] regionserver.HStore(310): Store=81790214badbeb2b84fbf777b424492a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:46,091 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:46,092 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 81790214badbeb2b84fbf777b424492a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61845423, jitterRate=-0.0784313827753067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:46,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 81790214badbeb2b84fbf777b424492a: Writing region info on filesystem at 1676300626077Initializing all the Stores at 1676300626078 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300626078Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300626078Region opened successfully at 1676300626092 (+14 ms) 2023-02-13 15:03:46,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 81790214badbeb2b84fbf777b424492a, disabling compactions & flushes 2023-02-13 15:03:46,110 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:46,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:46,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. after waiting 0 ms 2023-02-13 15:03:46,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:46,110 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676300621114.81790214badbeb2b84fbf777b424492a. 2023-02-13 15:03:46,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 81790214badbeb2b84fbf777b424492a: Waiting for close lock at 1676300626110Disabling compacts and flushes for region at 1676300626110Disabling writes for close at 1676300626110Writing region close event to WAL at 1676300626110Closed at 1676300626110 2023-02-13 15:03:46,615 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 15:03:46,615 WARN [Listener at localhost.localdomain/40345] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:46,621 INFO [Listener at localhost.localdomain/40345] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:46,726 WARN [BP-1759695349-148.251.75.209-1676300618921 heartbeating to localhost.localdomain/127.0.0.1:41523] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:46,726 WARN [BP-1759695349-148.251.75.209-1676300618921 heartbeating to localhost.localdomain/127.0.0.1:41523] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1759695349-148.251.75.209-1676300618921 (Datanode Uuid 1335cdcf-7c24-4947-a69e-545c31e6f5f5) service to localhost.localdomain/127.0.0.1:41523 2023-02-13 15:03:46,727 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d/dfs/data/data3/current/BP-1759695349-148.251.75.209-1676300618921] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:46,728 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d/dfs/data/data4/current/BP-1759695349-148.251.75.209-1676300618921] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:46,731 WARN [Listener at localhost.localdomain/40345] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:46,769 INFO [Listener at localhost.localdomain/40345] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:46,872 WARN [BP-1759695349-148.251.75.209-1676300618921 heartbeating to localhost.localdomain/127.0.0.1:41523] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:46,872 WARN [BP-1759695349-148.251.75.209-1676300618921 heartbeating to localhost.localdomain/127.0.0.1:41523] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1759695349-148.251.75.209-1676300618921 (Datanode Uuid f1e2f5f7-a98c-4cd9-a715-0a27d257bf75) service to localhost.localdomain/127.0.0.1:41523 2023-02-13 15:03:46,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d/dfs/data/data1/current/BP-1759695349-148.251.75.209-1676300618921] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:46,873 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/cluster_21d50780-8768-4a03-47ee-a4bb6105818d/dfs/data/data2/current/BP-1759695349-148.251.75.209-1676300618921] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:46,881 INFO [Listener at localhost.localdomain/40345] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 15:03:46,998 INFO [Listener at localhost.localdomain/40345] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 15:03:47,040 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 15:03:47,052 INFO [Listener at localhost.localdomain/40345] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=158 (was 103) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:41523 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/40345 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:41523 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:41523 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase20.apache.org,44327,1676300619515)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost.localdomain:41523 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost.localdomain:41523 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:41523 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:41523 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=541 (was 551), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 186) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=7183 (was 7563) 2023-02-13 15:03:47,061 INFO [Listener at localhost.localdomain/40345] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=158, OpenFileDescriptor=541, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=164, AvailableMemoryMB=7183 2023-02-13 15:03:47,069 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop.log.dir so I do NOT create it in target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024 2023-02-13 15:03:47,069 WARN [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 15:03:47,069 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop.tmp.dir so I do NOT create it in target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024 2023-02-13 15:03:47,069 WARN [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d1d4dc76-67b2-f1b5-6c4c-1d4c20494c99/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 15:03:47,069 DEBUG [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024 2023-02-13 15:03:47,069 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 15:03:47,069 INFO [Listener at localhost.localdomain/40345] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88, deleteOnExit=true 2023-02-13 15:03:47,069 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/test.cache.data in system properties and HBase conf 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/hadoop.log.dir in system properties and HBase conf 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 15:03:47,070 DEBUG [Listener at localhost.localdomain/40345] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:47,070 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/nfs.dump.dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/java.io.tmpdir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:47,071 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 15:03:47,072 INFO [Listener at localhost.localdomain/40345] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 15:03:47,074 WARN [Listener at localhost.localdomain/40345] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:47,074 WARN [Listener at localhost.localdomain/40345] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:47,094 WARN [Listener at localhost.localdomain/40345] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 15:03:47,142 WARN [Listener at localhost.localdomain/40345] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:47,144 INFO [Listener at localhost.localdomain/40345] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:47,150 INFO [Listener at localhost.localdomain/40345] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/java.io.tmpdir/Jetty_localhost_localdomain_33195_hdfs____.8ybkop/webapp 2023-02-13 15:03:47,222 INFO [Listener at localhost.localdomain/40345] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:33195 2023-02-13 15:03:47,225 WARN [Listener at localhost.localdomain/40345] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:47,225 WARN [Listener at localhost.localdomain/40345] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:47,249 WARN [Listener at localhost.localdomain/37333] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:47,264 WARN [Listener at localhost.localdomain/37333] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:47,266 WARN [Listener at localhost.localdomain/37333] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:47,267 INFO [Listener at localhost.localdomain/37333] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:47,271 INFO [Listener at localhost.localdomain/37333] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/java.io.tmpdir/Jetty_localhost_35351_datanode____.nbhl4c/webapp 2023-02-13 15:03:47,343 INFO [Listener at localhost.localdomain/37333] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35351 2023-02-13 15:03:47,351 WARN [Listener at localhost.localdomain/34487] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:47,362 WARN [Listener at localhost.localdomain/34487] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:47,364 WARN [Listener at localhost.localdomain/34487] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:47,365 INFO [Listener at localhost.localdomain/34487] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:47,370 INFO [Listener at localhost.localdomain/34487] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/java.io.tmpdir/Jetty_localhost_36165_datanode____wnxexg/webapp 2023-02-13 15:03:47,428 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc91c6958134eee7e: Processing first storage report for DS-82687a7f-1b53-441a-9dc0-696453bf86d3 from datanode 8d5964ad-2286-43bc-a097-a4db919a3ec4 2023-02-13 15:03:47,428 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc91c6958134eee7e: from storage DS-82687a7f-1b53-441a-9dc0-696453bf86d3 node DatanodeRegistration(127.0.0.1:42001, datanodeUuid=8d5964ad-2286-43bc-a097-a4db919a3ec4, infoPort=43473, infoSecurePort=0, ipcPort=34487, storageInfo=lv=-57;cid=testClusterID;nsid=1043168147;c=1676300627075), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:47,428 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc91c6958134eee7e: Processing first storage report for DS-99fe0fd6-55f4-4922-9f4b-4a8ab339ef70 from datanode 8d5964ad-2286-43bc-a097-a4db919a3ec4 2023-02-13 15:03:47,428 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc91c6958134eee7e: from storage DS-99fe0fd6-55f4-4922-9f4b-4a8ab339ef70 node DatanodeRegistration(127.0.0.1:42001, datanodeUuid=8d5964ad-2286-43bc-a097-a4db919a3ec4, infoPort=43473, infoSecurePort=0, ipcPort=34487, storageInfo=lv=-57;cid=testClusterID;nsid=1043168147;c=1676300627075), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:47,452 INFO [Listener at localhost.localdomain/34487] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36165 2023-02-13 15:03:47,462 WARN [Listener at localhost.localdomain/35579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:47,522 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa7939ce09bce9123: Processing first storage report for DS-12810552-53b9-4ef7-aa6f-33c1994d1428 from datanode 0faff577-f2a3-44c6-8201-02269017e2af 2023-02-13 15:03:47,522 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa7939ce09bce9123: from storage DS-12810552-53b9-4ef7-aa6f-33c1994d1428 node DatanodeRegistration(127.0.0.1:43831, datanodeUuid=0faff577-f2a3-44c6-8201-02269017e2af, infoPort=41343, infoSecurePort=0, ipcPort=35579, storageInfo=lv=-57;cid=testClusterID;nsid=1043168147;c=1676300627075), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:47,522 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa7939ce09bce9123: Processing first storage report for DS-1e32b37c-4f0f-4f46-bde5-e07de8055f03 from datanode 0faff577-f2a3-44c6-8201-02269017e2af 2023-02-13 15:03:47,522 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa7939ce09bce9123: from storage DS-1e32b37c-4f0f-4f46-bde5-e07de8055f03 node DatanodeRegistration(127.0.0.1:43831, datanodeUuid=0faff577-f2a3-44c6-8201-02269017e2af, infoPort=41343, infoSecurePort=0, ipcPort=35579, storageInfo=lv=-57;cid=testClusterID;nsid=1043168147;c=1676300627075), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:47,572 DEBUG [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024 2023-02-13 15:03:47,574 INFO [Listener at localhost.localdomain/35579] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88/zookeeper_0, clientPort=52919, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 15:03:47,574 INFO [Listener at localhost.localdomain/35579] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52919 2023-02-13 15:03:47,575 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,575 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,586 INFO [Listener at localhost.localdomain/35579] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc with version=8 2023-02-13 15:03:47,587 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,587 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,588 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:37333/user/jenkins/test-data/dba0b06b-3f50-e630-4b0c-0a8adca957b6/hbase-staging 2023-02-13 15:03:47,590 INFO [Listener at localhost.localdomain/35579] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:47,590 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,590 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,590 INFO [Listener at localhost.localdomain/35579] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:47,590 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,590 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:47,590 INFO [Listener at localhost.localdomain/35579] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:47,591 INFO [Listener at localhost.localdomain/35579] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44727 2023-02-13 15:03:47,592 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,592 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,593 INFO [Listener at localhost.localdomain/35579] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44727 connecting to ZooKeeper ensemble=127.0.0.1:52919 2023-02-13 15:03:47,598 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:447270x0, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:47,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44727-0x1015c5d70240000 connected 2023-02-13 15:03:47,612 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:47,613 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:47,613 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:47,615 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44727 2023-02-13 15:03:47,615 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44727 2023-02-13 15:03:47,615 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44727 2023-02-13 15:03:47,619 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44727 2023-02-13 15:03:47,619 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44727 2023-02-13 15:03:47,619 INFO [Listener at localhost.localdomain/35579] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc, hbase.cluster.distributed=false 2023-02-13 15:03:47,630 INFO [Listener at localhost.localdomain/35579] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:47,630 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,630 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,630 INFO [Listener at localhost.localdomain/35579] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:47,630 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,630 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:47,630 INFO [Listener at localhost.localdomain/35579] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:47,632 INFO [Listener at localhost.localdomain/35579] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43083 2023-02-13 15:03:47,632 INFO [Listener at localhost.localdomain/35579] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:47,633 DEBUG [Listener at localhost.localdomain/35579] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:47,634 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,635 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,635 INFO [Listener at localhost.localdomain/35579] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43083 connecting to ZooKeeper ensemble=127.0.0.1:52919 2023-02-13 15:03:47,638 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:430830x0, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:47,639 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): regionserver:430830x0, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:47,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43083-0x1015c5d70240001 connected 2023-02-13 15:03:47,640 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:47,641 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:47,641 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43083 2023-02-13 15:03:47,641 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43083 2023-02-13 15:03:47,643 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43083 2023-02-13 15:03:47,643 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43083 2023-02-13 15:03:47,644 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43083 2023-02-13 15:03:47,658 INFO [Listener at localhost.localdomain/35579] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:47,658 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,658 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,658 INFO [Listener at localhost.localdomain/35579] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:47,658 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:47,659 INFO [Listener at localhost.localdomain/35579] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:47,659 INFO [Listener at localhost.localdomain/35579] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:47,661 INFO [Listener at localhost.localdomain/35579] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33655 2023-02-13 15:03:47,662 INFO [Listener at localhost.localdomain/35579] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:47,663 DEBUG [Listener at localhost.localdomain/35579] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:47,664 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,665 INFO [Listener at localhost.localdomain/35579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,666 INFO [Listener at localhost.localdomain/35579] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33655 connecting to ZooKeeper ensemble=127.0.0.1:52919 2023-02-13 15:03:47,671 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:336550x0, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:47,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33655-0x1015c5d70240002 connected 2023-02-13 15:03:47,673 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:47,674 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:47,675 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:47,676 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33655 2023-02-13 15:03:47,677 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33655 2023-02-13 15:03:47,679 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33655 2023-02-13 15:03:47,679 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33655 2023-02-13 15:03:47,679 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33655 2023-02-13 15:03:47,681 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:47,687 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:47,687 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:47,688 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:47,688 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:47,688 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:47,689 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:47,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:47,690 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44727,1676300627589 from backup master directory 2023-02-13 15:03:47,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:47,691 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:47,691 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:47,692 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:47,692 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:47,705 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/hbase.id with ID: 8ac1ac2d-797d-4f0c-8bac-b10e87b3d087 2023-02-13 15:03:47,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:47,715 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:47,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x04eed2c3 to 127.0.0.1:52919 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:47,732 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@201efe5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:47,733 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:47,733 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 15:03:47,733 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:47,735 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store-tmp 2023-02-13 15:03:47,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:47,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:47,741 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:47,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:47,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:47,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:47,741 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:47,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300627741Disabling compacts and flushes for region at 1676300627741Disabling writes for close at 1676300627741Writing region close event to WAL at 1676300627741Closed at 1676300627741 2023-02-13 15:03:47,742 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/WALs/jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:47,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44727%2C1676300627589, suffix=, logDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/WALs/jenkins-hbase20.apache.org,44727,1676300627589, archiveDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/oldWALs, maxLogs=10 2023-02-13 15:03:47,759 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK] 2023-02-13 15:03:47,760 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK] 2023-02-13 15:03:47,762 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/WALs/jenkins-hbase20.apache.org,44727,1676300627589/jenkins-hbase20.apache.org%2C44727%2C1676300627589.1676300627744 2023-02-13 15:03:47,762 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK], DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK]] 2023-02-13 15:03:47,762 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:47,762 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:47,762 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:47,762 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:47,763 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:47,764 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 15:03:47,765 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 15:03:47,765 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:47,766 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:47,766 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:47,769 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:47,771 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:47,772 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67437801, jitterRate=0.0049015432596206665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:47,772 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676300627762Initializing all the Stores at 1676300627763 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300627763Cleaning up temporary data from old regions at 1676300627767 (+4 ms)Cleaning up detritus from prior splits at 1676300627767Region opened successfully at 1676300627772 (+5 ms) 2023-02-13 15:03:47,772 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 15:03:47,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 15:03:47,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 15:03:47,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 15:03:47,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 15:03:47,774 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 15:03:47,774 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 15:03:47,774 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 15:03:47,775 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 15:03:47,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 15:03:47,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 15:03:47,783 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 15:03:47,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 15:03:47,784 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 15:03:47,785 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:47,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 15:03:47,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 15:03:47,787 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 15:03:47,787 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:47,787 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:47,787 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:47,787 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:47,788 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,44727,1676300627589, sessionid=0x1015c5d70240000, setting cluster-up flag (Was=false) 2023-02-13 15:03:47,790 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:47,792 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 15:03:47,793 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:47,795 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:47,797 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 15:03:47,797 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:47,798 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.hbase-snapshot/.tmp 2023-02-13 15:03:47,799 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676300657803 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 15:03:47,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,805 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:47,805 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 15:03:47,805 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 15:03:47,805 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 15:03:47,805 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 15:03:47,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 15:03:47,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 15:03:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300627806,5,FailOnTimeoutGroup] 2023-02-13 15:03:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300627806,5,FailOnTimeoutGroup] 2023-02-13 15:03:47,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 15:03:47,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,806 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:47,818 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:47,818 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:47,818 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc 2023-02-13 15:03:47,832 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:47,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:47,834 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/info 2023-02-13 15:03:47,834 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:47,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:47,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:47,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:47,836 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:47,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:47,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:47,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/table 2023-02-13 15:03:47,837 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:47,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:47,838 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740 2023-02-13 15:03:47,839 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740 2023-02-13 15:03:47,840 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:47,841 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:47,843 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:47,843 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65910736, jitterRate=-0.017853498458862305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:47,843 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676300627832Initializing all the Stores at 1676300627832Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300627832Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300627832Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300627832Cleaning up temporary data from old regions at 1676300627839 (+7 ms)Cleaning up detritus from prior splits at 1676300627840 (+1 ms)Region opened successfully at 1676300627843 (+3 ms) 2023-02-13 15:03:47,843 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:47,843 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:47,843 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:47,843 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:47,843 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:47,843 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:47,843 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300627843Disabling compacts and flushes for region at 1676300627843Disabling writes for close at 1676300627843Writing region close event to WAL at 1676300627843Closed at 1676300627843 2023-02-13 15:03:47,844 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:47,844 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 15:03:47,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 15:03:47,846 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 15:03:47,847 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 15:03:47,882 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(952): ClusterId : 8ac1ac2d-797d-4f0c-8bac-b10e87b3d087 2023-02-13 15:03:47,882 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(952): ClusterId : 8ac1ac2d-797d-4f0c-8bac-b10e87b3d087 2023-02-13 15:03:47,882 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:47,882 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:47,883 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:47,884 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:47,883 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:47,884 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:47,885 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:47,887 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:47,887 DEBUG [RS:0;jenkins-hbase20:43083] zookeeper.ReadOnlyZKClient(139): Connect 0x3ffcb577 to 127.0.0.1:52919 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:47,888 DEBUG [RS:1;jenkins-hbase20:33655] zookeeper.ReadOnlyZKClient(139): Connect 0x0f10dabc to 127.0.0.1:52919 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:47,899 DEBUG [RS:0;jenkins-hbase20:43083] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@313b4cf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:47,900 DEBUG [RS:1;jenkins-hbase20:33655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d7252e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:47,900 DEBUG [RS:0;jenkins-hbase20:43083] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3504de07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:47,900 DEBUG [RS:1;jenkins-hbase20:33655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e8b1cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:47,906 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:33655 2023-02-13 15:03:47,907 INFO [RS:1;jenkins-hbase20:33655] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:47,907 INFO [RS:1;jenkins-hbase20:33655] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:47,907 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:47,907 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44727,1676300627589 with isa=jenkins-hbase20.apache.org/148.251.75.209:33655, startcode=1676300627657 2023-02-13 15:03:47,908 DEBUG [RS:1;jenkins-hbase20:33655] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:47,908 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43083 2023-02-13 15:03:47,908 INFO [RS:0;jenkins-hbase20:43083] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:47,908 INFO [RS:0;jenkins-hbase20:43083] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:47,908 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:47,909 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44727,1676300627589 with isa=jenkins-hbase20.apache.org/148.251.75.209:43083, startcode=1676300627629 2023-02-13 15:03:47,909 DEBUG [RS:0;jenkins-hbase20:43083] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:47,910 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41527, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:47,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:47,912 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49031, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:47,913 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc 2023-02-13 15:03:47,913 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37333 2023-02-13 15:03:47,913 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:47,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:47,913 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc 2023-02-13 15:03:47,913 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37333 2023-02-13 15:03:47,913 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:47,914 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:47,915 DEBUG [RS:1;jenkins-hbase20:33655] zookeeper.ZKUtil(162): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:47,915 WARN [RS:1;jenkins-hbase20:33655] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:47,915 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,33655,1676300627657] 2023-02-13 15:03:47,915 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43083,1676300627629] 2023-02-13 15:03:47,915 DEBUG [RS:0;jenkins-hbase20:43083] zookeeper.ZKUtil(162): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:47,915 INFO [RS:1;jenkins-hbase20:33655] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:47,916 WARN [RS:0;jenkins-hbase20:43083] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:47,916 INFO [RS:0;jenkins-hbase20:43083] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:47,916 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:47,916 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:47,922 DEBUG [RS:0;jenkins-hbase20:43083] zookeeper.ZKUtil(162): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:47,922 DEBUG [RS:1;jenkins-hbase20:33655] zookeeper.ZKUtil(162): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:47,922 DEBUG [RS:0;jenkins-hbase20:43083] zookeeper.ZKUtil(162): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:47,922 DEBUG [RS:1;jenkins-hbase20:33655] zookeeper.ZKUtil(162): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:47,923 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:47,923 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:47,923 INFO [RS:1;jenkins-hbase20:33655] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:47,923 INFO [RS:0;jenkins-hbase20:43083] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:47,924 INFO [RS:1;jenkins-hbase20:33655] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:47,925 INFO [RS:1;jenkins-hbase20:33655] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:47,925 INFO [RS:0;jenkins-hbase20:43083] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:47,925 INFO [RS:1;jenkins-hbase20:33655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,925 INFO [RS:0;jenkins-hbase20:43083] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:47,925 INFO [RS:0;jenkins-hbase20:43083] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,927 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:47,930 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:47,932 INFO [RS:1;jenkins-hbase20:33655] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,932 INFO [RS:0;jenkins-hbase20:43083] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,932 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:1;jenkins-hbase20:33655] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,933 DEBUG [RS:0;jenkins-hbase20:43083] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:47,936 INFO [RS:1;jenkins-hbase20:33655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,936 INFO [RS:0;jenkins-hbase20:43083] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,936 INFO [RS:1;jenkins-hbase20:33655] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,936 INFO [RS:0;jenkins-hbase20:43083] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,936 INFO [RS:1;jenkins-hbase20:33655] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,936 INFO [RS:0;jenkins-hbase20:43083] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,950 INFO [RS:1;jenkins-hbase20:33655] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:47,950 INFO [RS:0;jenkins-hbase20:43083] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:47,950 INFO [RS:1;jenkins-hbase20:33655] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33655,1676300627657-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,951 INFO [RS:0;jenkins-hbase20:43083] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43083,1676300627629-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:47,965 INFO [RS:0;jenkins-hbase20:43083] regionserver.Replication(203): jenkins-hbase20.apache.org,43083,1676300627629 started 2023-02-13 15:03:47,965 INFO [RS:1;jenkins-hbase20:33655] regionserver.Replication(203): jenkins-hbase20.apache.org,33655,1676300627657 started 2023-02-13 15:03:47,965 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,43083,1676300627629, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43083, sessionid=0x1015c5d70240001 2023-02-13 15:03:47,965 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,33655,1676300627657, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:33655, sessionid=0x1015c5d70240002 2023-02-13 15:03:47,965 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:47,965 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:47,965 DEBUG [RS:1;jenkins-hbase20:33655] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:47,965 DEBUG [RS:0;jenkins-hbase20:43083] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:47,965 DEBUG [RS:1;jenkins-hbase20:33655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33655,1676300627657' 2023-02-13 15:03:47,965 DEBUG [RS:1;jenkins-hbase20:33655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:47,965 DEBUG [RS:0;jenkins-hbase20:43083] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43083,1676300627629' 2023-02-13 15:03:47,965 DEBUG [RS:0;jenkins-hbase20:43083] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:47,966 DEBUG [RS:1;jenkins-hbase20:33655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:47,966 DEBUG [RS:0;jenkins-hbase20:43083] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:47,966 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:47,966 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:47,966 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:47,966 DEBUG [RS:1;jenkins-hbase20:33655] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:47,966 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:47,966 DEBUG [RS:1;jenkins-hbase20:33655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33655,1676300627657' 2023-02-13 15:03:47,966 DEBUG [RS:0;jenkins-hbase20:43083] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:47,966 DEBUG [RS:1;jenkins-hbase20:33655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:47,966 DEBUG [RS:0;jenkins-hbase20:43083] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43083,1676300627629' 2023-02-13 15:03:47,966 DEBUG [RS:0;jenkins-hbase20:43083] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:47,966 DEBUG [RS:1;jenkins-hbase20:33655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:47,966 DEBUG [RS:0;jenkins-hbase20:43083] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:47,967 DEBUG [RS:1;jenkins-hbase20:33655] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:47,967 INFO [RS:1;jenkins-hbase20:33655] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:47,967 DEBUG [RS:0;jenkins-hbase20:43083] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:47,967 INFO [RS:1;jenkins-hbase20:33655] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:47,967 INFO [RS:0;jenkins-hbase20:43083] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:47,967 INFO [RS:0;jenkins-hbase20:43083] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:47,997 DEBUG [jenkins-hbase20:44727] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 15:03:47,997 DEBUG [jenkins-hbase20:44727] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:47,999 DEBUG [jenkins-hbase20:44727] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:47,999 DEBUG [jenkins-hbase20:44727] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:47,999 DEBUG [jenkins-hbase20:44727] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:48,000 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43083,1676300627629, state=OPENING 2023-02-13 15:03:48,001 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 15:03:48,002 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:48,002 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:48,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43083,1676300627629}] 2023-02-13 15:03:48,156 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:48,156 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:48,158 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47042, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:48,162 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 15:03:48,162 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:48,164 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43083%2C1676300627629.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,43083,1676300627629, archiveDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/oldWALs, maxLogs=32 2023-02-13 15:03:48,182 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK] 2023-02-13 15:03:48,182 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK] 2023-02-13 15:03:48,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,43083,1676300627629/jenkins-hbase20.apache.org%2C43083%2C1676300627629.meta.1676300628165.meta 2023-02-13 15:03:48,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK], DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK]] 2023-02-13 15:03:48,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:48,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 15:03:48,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 15:03:48,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 15:03:48,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 15:03:48,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:48,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 15:03:48,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 15:03:48,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:48,190 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/info 2023-02-13 15:03:48,190 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/info 2023-02-13 15:03:48,191 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:48,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:48,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:48,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:48,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:48,192 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:48,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:48,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:48,194 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/table 2023-02-13 15:03:48,194 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/table 2023-02-13 15:03:48,194 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:48,195 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:48,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740 2023-02-13 15:03:48,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740 2023-02-13 15:03:48,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:48,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:48,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68545679, jitterRate=0.02141021192073822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:48,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676300628188Writing region info on filesystem at 1676300628188Initializing all the Stores at 1676300628189 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300628189Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300628189Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300628189Cleaning up temporary data from old regions at 1676300628197 (+8 ms)Cleaning up detritus from prior splits at 1676300628198 (+1 ms)Running coprocessor post-open hooks at 1676300628200 (+2 ms)Region opened successfully at 1676300628200 2023-02-13 15:03:48,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676300628156 2023-02-13 15:03:48,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 15:03:48,207 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 15:03:48,207 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43083,1676300627629, state=OPEN 2023-02-13 15:03:48,208 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 15:03:48,208 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:48,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 15:03:48,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43083,1676300627629 in 206 msec 2023-02-13 15:03:48,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 15:03:48,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 366 msec 2023-02-13 15:03:48,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 413 msec 2023-02-13 15:03:48,213 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676300627687, completionTime=-1 2023-02-13 15:03:48,213 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 15:03:48,213 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 15:03:48,221 DEBUG [hconnection-0x35da9cd6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:48,222 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:48,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 15:03:48,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676300688224 2023-02-13 15:03:48,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676300748224 2023-02-13 15:03:48,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 11 msec 2023-02-13 15:03:48,233 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44727,1676300627589-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:48,233 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44727,1676300627589-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:48,233 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44727,1676300627589-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:48,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44727, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:48,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:48,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 15:03:48,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:48,235 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 15:03:48,242 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 15:03:48,242 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:48,243 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:48,245 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/hbase/namespace/a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,245 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/hbase/namespace/a4676175977fc278284f6915dacdf010 empty. 2023-02-13 15:03:48,246 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/hbase/namespace/a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,246 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 15:03:48,261 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:48,263 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a4676175977fc278284f6915dacdf010, NAME => 'hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp 2023-02-13 15:03:48,273 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:48,273 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a4676175977fc278284f6915dacdf010, disabling compactions & flushes 2023-02-13 15:03:48,273 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:48,273 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:48,273 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. after waiting 0 ms 2023-02-13 15:03:48,273 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:48,273 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:48,273 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a4676175977fc278284f6915dacdf010: Waiting for close lock at 1676300628273Disabling compacts and flushes for region at 1676300628273Disabling writes for close at 1676300628273Writing region close event to WAL at 1676300628273Closed at 1676300628273 2023-02-13 15:03:48,275 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:48,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300628276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300628276"}]},"ts":"1676300628276"} 2023-02-13 15:03:48,278 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:03:48,279 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:48,279 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300628279"}]},"ts":"1676300628279"} 2023-02-13 15:03:48,280 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 15:03:48,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:48,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:48,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:48,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:48,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a4676175977fc278284f6915dacdf010, ASSIGN}] 2023-02-13 15:03:48,286 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a4676175977fc278284f6915dacdf010, ASSIGN 2023-02-13 15:03:48,287 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a4676175977fc278284f6915dacdf010, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33655,1676300627657; forceNewPlan=false, retain=false 2023-02-13 15:03:48,437 INFO [jenkins-hbase20:44727] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:03:48,438 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a4676175977fc278284f6915dacdf010, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:48,439 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300628438"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300628438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300628438"}]},"ts":"1676300628438"} 2023-02-13 15:03:48,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a4676175977fc278284f6915dacdf010, server=jenkins-hbase20.apache.org,33655,1676300627657}] 2023-02-13 15:03:48,593 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:48,593 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:48,594 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37728, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:48,598 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:48,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33655%2C1676300627657, suffix=, logDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,33655,1676300627657, archiveDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/oldWALs, maxLogs=32 2023-02-13 15:03:48,613 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK] 2023-02-13 15:03:48,613 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK] 2023-02-13 15:03:48,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,33655,1676300627657/jenkins-hbase20.apache.org%2C33655%2C1676300627657.1676300628600 2023-02-13 15:03:48,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK], DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK]] 2023-02-13 15:03:48,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a4676175977fc278284f6915dacdf010, NAME => 'hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:48,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:48,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,616 INFO [StoreOpener-a4676175977fc278284f6915dacdf010-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,617 DEBUG [StoreOpener-a4676175977fc278284f6915dacdf010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/info 2023-02-13 15:03:48,617 DEBUG [StoreOpener-a4676175977fc278284f6915dacdf010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/info 2023-02-13 15:03:48,617 INFO [StoreOpener-a4676175977fc278284f6915dacdf010-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4676175977fc278284f6915dacdf010 columnFamilyName info 2023-02-13 15:03:48,618 INFO [StoreOpener-a4676175977fc278284f6915dacdf010-1] regionserver.HStore(310): Store=a4676175977fc278284f6915dacdf010/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:48,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for a4676175977fc278284f6915dacdf010 2023-02-13 15:03:48,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:48,626 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened a4676175977fc278284f6915dacdf010; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59697537, jitterRate=-0.11043737828731537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:48,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for a4676175977fc278284f6915dacdf010: Running coprocessor pre-open hook at 1676300628615Writing region info on filesystem at 1676300628615Initializing all the Stores at 1676300628616 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300628616Cleaning up temporary data from old regions at 1676300628620 (+4 ms)Cleaning up detritus from prior splits at 1676300628620Running coprocessor post-open hooks at 1676300628626 (+6 ms)Region opened successfully at 1676300628626 2023-02-13 15:03:48,626 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010., pid=6, masterSystemTime=1676300628593 2023-02-13 15:03:48,629 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:48,630 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:48,630 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a4676175977fc278284f6915dacdf010, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:48,631 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300628630"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300628630"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300628630"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300628630"}]},"ts":"1676300628630"} 2023-02-13 15:03:48,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 15:03:48,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a4676175977fc278284f6915dacdf010, server=jenkins-hbase20.apache.org,33655,1676300627657 in 192 msec 2023-02-13 15:03:48,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 15:03:48,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a4676175977fc278284f6915dacdf010, ASSIGN in 351 msec 2023-02-13 15:03:48,636 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:48,636 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300628636"}]},"ts":"1676300628636"} 2023-02-13 15:03:48,638 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 15:03:48,639 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:48,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 405 msec 2023-02-13 15:03:48,736 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 15:03:48,737 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:48,737 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:48,740 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:48,741 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:48,742 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 15:03:48,751 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:48,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-13 15:03:48,765 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 15:03:48,774 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:48,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-13 15:03:48,788 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 15:03:48,789 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 15:03:48,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.098sec 2023-02-13 15:03:48,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 15:03:48,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 15:03:48,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 15:03:48,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44727,1676300627589-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 15:03:48,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44727,1676300627589-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 15:03:48,792 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 15:03:48,882 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ReadOnlyZKClient(139): Connect 0x7426de7d to 127.0.0.1:52919 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:48,887 DEBUG [Listener at localhost.localdomain/35579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e0f20b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:48,889 DEBUG [hconnection-0x362c6dd3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:48,891 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47058, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:48,892 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:48,892 DEBUG [Listener at localhost.localdomain/35579] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 15:03:48,895 DEBUG [Listener at localhost.localdomain/35579] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 15:03:48,897 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 15:03:48,898 INFO [Listener at localhost.localdomain/35579] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:48,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:48,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:03:48,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 148.251.75.209:42830 deadline: 1676300688898, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:48,899 INFO [Listener at localhost.localdomain/35579] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 15:03:48,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:48,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:48,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:48,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-13 15:03:48,906 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:48,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:48,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:48,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434 empty. 2023-02-13 15:03:48,909 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:48,909 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 15:03:48,920 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:48,921 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5478f7ab31cf990843e26080344a5434, NAME => 'testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp 2023-02-13 15:03:48,928 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:48,928 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 5478f7ab31cf990843e26080344a5434, disabling compactions & flushes 2023-02-13 15:03:48,928 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:48,928 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:48,928 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. after waiting 0 ms 2023-02-13 15:03:48,928 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:48,929 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:48,929 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 5478f7ab31cf990843e26080344a5434: Waiting for close lock at 1676300628928Disabling compacts and flushes for region at 1676300628928Disabling writes for close at 1676300628928Writing region close event to WAL at 1676300628929 (+1 ms)Closed at 1676300628929 2023-02-13 15:03:48,931 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:48,932 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676300628931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300628931"}]},"ts":"1676300628931"} 2023-02-13 15:03:48,933 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:03:48,934 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:48,934 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300628934"}]},"ts":"1676300628934"} 2023-02-13 15:03:48,935 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-13 15:03:48,938 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:48,939 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:48,939 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:48,939 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:48,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5478f7ab31cf990843e26080344a5434, ASSIGN}] 2023-02-13 15:03:48,941 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5478f7ab31cf990843e26080344a5434, ASSIGN 2023-02-13 15:03:48,941 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5478f7ab31cf990843e26080344a5434, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43083,1676300627629; forceNewPlan=false, retain=false 2023-02-13 15:03:48,969 INFO [RS:0;jenkins-hbase20:43083] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43083%2C1676300627629, suffix=, logDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,43083,1676300627629, archiveDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/oldWALs, maxLogs=32 2023-02-13 15:03:48,981 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK] 2023-02-13 15:03:48,982 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK] 2023-02-13 15:03:48,985 INFO [RS:0;jenkins-hbase20:43083] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,43083,1676300627629/jenkins-hbase20.apache.org%2C43083%2C1676300627629.1676300628969 2023-02-13 15:03:48,985 DEBUG [RS:0;jenkins-hbase20:43083] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43831,DS-12810552-53b9-4ef7-aa6f-33c1994d1428,DISK], DatanodeInfoWithStorage[127.0.0.1:42001,DS-82687a7f-1b53-441a-9dc0-696453bf86d3,DISK]] 2023-02-13 15:03:49,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:49,092 INFO [jenkins-hbase20:44727] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:03:49,093 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5478f7ab31cf990843e26080344a5434, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:49,093 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676300629093"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300629093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300629093"}]},"ts":"1676300629093"} 2023-02-13 15:03:49,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 5478f7ab31cf990843e26080344a5434, server=jenkins-hbase20.apache.org,43083,1676300627629}] 2023-02-13 15:03:49,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:49,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:49,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5478f7ab31cf990843e26080344a5434, NAME => 'testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:49,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:49,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,252 INFO [StoreOpener-5478f7ab31cf990843e26080344a5434-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,253 DEBUG [StoreOpener-5478f7ab31cf990843e26080344a5434-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1 2023-02-13 15:03:49,253 DEBUG [StoreOpener-5478f7ab31cf990843e26080344a5434-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1 2023-02-13 15:03:49,253 INFO [StoreOpener-5478f7ab31cf990843e26080344a5434-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5478f7ab31cf990843e26080344a5434 columnFamilyName f1 2023-02-13 15:03:49,254 INFO [StoreOpener-5478f7ab31cf990843e26080344a5434-1] regionserver.HStore(310): Store=5478f7ab31cf990843e26080344a5434/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:49,254 INFO [StoreOpener-5478f7ab31cf990843e26080344a5434-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,255 DEBUG [StoreOpener-5478f7ab31cf990843e26080344a5434-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2 2023-02-13 15:03:49,255 DEBUG [StoreOpener-5478f7ab31cf990843e26080344a5434-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2 2023-02-13 15:03:49,255 INFO [StoreOpener-5478f7ab31cf990843e26080344a5434-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5478f7ab31cf990843e26080344a5434 columnFamilyName f2 2023-02-13 15:03:49,256 INFO [StoreOpener-5478f7ab31cf990843e26080344a5434-1] regionserver.HStore(310): Store=5478f7ab31cf990843e26080344a5434/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:49,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:49,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:49,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:49,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5478f7ab31cf990843e26080344a5434; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62463271, jitterRate=-0.06922473013401031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:49,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5478f7ab31cf990843e26080344a5434: Running coprocessor pre-open hook at 1676300629251Writing region info on filesystem at 1676300629251Initializing all the Stores at 1676300629252 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300629252Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300629252Cleaning up temporary data from old regions at 1676300629257 (+5 ms)Cleaning up detritus from prior splits at 1676300629258 (+1 ms)Running coprocessor post-open hooks at 1676300629261 (+3 ms)Region opened successfully at 1676300629261 2023-02-13 15:03:49,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434., pid=12, masterSystemTime=1676300629247 2023-02-13 15:03:49,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:49,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:49,264 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5478f7ab31cf990843e26080344a5434, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:49,264 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676300629264"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300629264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300629264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300629264"}]},"ts":"1676300629264"} 2023-02-13 15:03:49,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 15:03:49,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 5478f7ab31cf990843e26080344a5434, server=jenkins-hbase20.apache.org,43083,1676300627629 in 171 msec 2023-02-13 15:03:49,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 15:03:49,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5478f7ab31cf990843e26080344a5434, ASSIGN in 329 msec 2023-02-13 15:03:49,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:49,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300629270"}]},"ts":"1676300629270"} 2023-02-13 15:03:49,271 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-13 15:03:49,273 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:49,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 372 msec 2023-02-13 15:03:49,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:49,513 INFO [Listener at localhost.localdomain/35579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-13 15:03:49,513 DEBUG [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-13 15:03:49,513 INFO [Listener at localhost.localdomain/35579] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:49,515 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-13 15:03:49,515 INFO [Listener at localhost.localdomain/35579] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:49,515 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-13 15:03:49,515 INFO [Listener at localhost.localdomain/35579] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 15:03:49,554 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43083] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:49,950 INFO [Listener at localhost.localdomain/35579] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 15:03:49,951 INFO [Listener at localhost.localdomain/35579] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 15:03:49,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 15:03:49,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676300629952 (current time:1676300629952). 2023-02-13 15:03:49,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 15:03:49,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] zookeeper.ReadOnlyZKClient(139): Connect 0x5c0d8d58 to 127.0.0.1:52919 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:49,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@353975d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:49,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:49,959 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:49,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c0d8d58 to 127.0.0.1:52919 2023-02-13 15:03:49,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:49,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 15:03:49,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 15:03:49,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 15:03:49,964 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 15:03:49,964 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676301229964 2023-02-13 15:03:49,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 15:03:49,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:49,965 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:49,966 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 15:03:49,966 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 15:03:49,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 15:03:49,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-13 15:03:49,968 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 15:03:49,968 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676301229968 2023-02-13 15:03:49,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 15:03:49,979 INFO [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 15:03:49,979 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:49,980 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 15:03:49,980 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 15:03:49,980 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 15:03:49,980 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 15:03:49,981 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:49,981 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:49,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:49,981 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:49,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:49,981 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 15:03:49,982 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 15:03:49,982 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 15:03:49,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 15:03:49,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 15:03:49,987 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 15:03:49,987 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:49,988 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 15:03:49,988 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 15:03:49,988 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33655,1676300627657' joining acquired barrier for procedure (foo) in zk 2023-02-13 15:03:49,989 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 15:03:49,989 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:49,990 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 15:03:49,990 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 15:03:49,990 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43083,1676300627629' joining acquired barrier for procedure (foo) in zk 2023-02-13 15:03:49,995 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 15:03:49,998 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 15:03:49,998 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 15:03:49,999 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:49,998 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:49,999 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 15:03:49,999 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:03:50,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:50,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43083,1676300627629' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 15:03:50,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ee76103[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:50,000 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 15:03:50,001 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,001 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,001 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,001 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,001 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:50,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,001 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 15:03:50,002 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 15:03:50,002 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 15:03:50,002 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,33655,1676300627657' in zk 2023-02-13 15:03:50,002 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 15:03:50,002 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:03:50,002 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,002 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. started... 2023-02-13 15:03:50,003 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5478f7ab31cf990843e26080344a5434 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 15:03:50,004 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 15:03:50,004 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:50,004 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 15:03:50,024 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f1/17f6f5f361b041b8a711e8112e54d2f1 2023-02-13 15:03:50,041 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f2/37e98d604a3a4ed289a55fdf191b4e41 2023-02-13 15:03:50,046 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f1/17f6f5f361b041b8a711e8112e54d2f1 as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/17f6f5f361b041b8a711e8112e54d2f1 2023-02-13 15:03:50,051 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/17f6f5f361b041b8a711e8112e54d2f1, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:03:50,052 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f2/37e98d604a3a4ed289a55fdf191b4e41 as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/37e98d604a3a4ed289a55fdf191b4e41 2023-02-13 15:03:50,056 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/37e98d604a3a4ed289a55fdf191b4e41, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:03:50,057 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 5478f7ab31cf990843e26080344a5434 in 54ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5478f7ab31cf990843e26080344a5434: 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.' region-info for snapshot=foo 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/17f6f5f361b041b8a711e8112e54d2f1] hfiles 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/17f6f5f361b041b8a711e8112e54d2f1 for snapshot=foo 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/37e98d604a3a4ed289a55fdf191b4e41] hfiles 2023-02-13 15:03:50,057 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/37e98d604a3a4ed289a55fdf191b4e41 for snapshot=foo 2023-02-13 15:03:50,064 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. completed. 2023-02-13 15:03:50,064 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,064 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 15:03:50,064 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 15:03:50,064 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,064 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 15:03:50,064 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,43083,1676300627629' in zk 2023-02-13 15:03:50,065 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 15:03:50,065 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,065 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:50,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:50,065 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 15:03:50,066 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:50,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:03:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 15:03:50,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,068 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 15:03:50,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:50,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:03:50,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,43083,1676300627629': 2023-02-13 15:03:50,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43083,1676300627629' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 15:03:50,069 INFO [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 15:03:50,069 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:50,069 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:50,069 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 15:03:50,069 INFO [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 15:03:50,070 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:50,070 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,070 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:50,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:50,071 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:50,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,071 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:03:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:50,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:03:50,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,072 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:50,072 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:03:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 15:03:50,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:50,075 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:50,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 15:03:50,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:50,075 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 15:03:50,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:50,076 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,076 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,076 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,076 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:03:50,076 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:03:50,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:50,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 15:03:50,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:50,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:50,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:50,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.hbase-snapshot/.tmp/foo 2023-02-13 15:03:50,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.hbase-snapshot/foo 2023-02-13 15:03:50,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-13 15:03:50,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.hbase-snapshot/.tmp/foo 2023-02-13 15:03:50,110 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.hbase-snapshot/.tmp/foo 2023-02-13 15:03:50,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676300629964Consolidate snapshot: foo at 1676300630076 (+112 ms)Loading Region manifests for foo at 1676300630077 (+1 ms)Writing data manifest for foo at 1676300630080 (+3 ms)Verifying snapshot: foo at 1676300630086 (+6 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676300630109 (+23 ms) 2023-02-13 15:03:50,111 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 15:03:50,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 146 msec 2023-02-13 15:03:50,268 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:50,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 15:03:50,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 15:03:50,269 INFO [Listener at localhost.localdomain/35579] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 15:03:50,273 INFO [Listener at localhost.localdomain/35579] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 15:03:50,278 INFO [Listener at localhost.localdomain/35579] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 15:03:50,313 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43083] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,413 INFO [Listener at localhost.localdomain/35579] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 15:03:50,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 15:03:50,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,423 INFO [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-13 15:03:50,423 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:50,423 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-13 15:03:50,423 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-13 15:03:50,424 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,424 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,425 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,425 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:50,425 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:50,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:50,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:50,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:50,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:50,425 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,425 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:50,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,431 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 15:03:50,431 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:50,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,432 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 15:03:50,434 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 15:03:50,434 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:50,435 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 15:03:50,435 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:03:50,435 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 15:03:50,435 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 15:03:50,435 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33655,1676300627657' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 15:03:50,435 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,435 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. started... 2023-02-13 15:03:50,436 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5478f7ab31cf990843e26080344a5434 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 15:03:50,437 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,437 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,437 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:50,455 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f1/4edab8bfbd7f427a995a73d34055b53d 2023-02-13 15:03:50,475 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f2/c5b6ba6431ea48f1a884963b3cea846f 2023-02-13 15:03:50,479 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f1/4edab8bfbd7f427a995a73d34055b53d as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/4edab8bfbd7f427a995a73d34055b53d 2023-02-13 15:03:50,483 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/4edab8bfbd7f427a995a73d34055b53d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:03:50,484 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/.tmp/f2/c5b6ba6431ea48f1a884963b3cea846f as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/c5b6ba6431ea48f1a884963b3cea846f 2023-02-13 15:03:50,489 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/c5b6ba6431ea48f1a884963b3cea846f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:03:50,490 INFO [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 5478f7ab31cf990843e26080344a5434 in 54ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:50,491 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5478f7ab31cf990843e26080344a5434: 2023-02-13 15:03:50,491 DEBUG [rs(jenkins-hbase20.apache.org,43083,1676300627629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,491 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 15:03:50,491 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 15:03:50,491 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,491 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 15:03:50,491 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43083,1676300627629' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 15:03:50,492 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,492 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:50,492 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,492 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:50,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43083,1676300627629' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-13 15:03:50,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad8f607[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:50,494 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-13 15:03:50,494 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,494 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,494 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,495 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 15:03:50,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,495 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 15:03:50,495 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,33655,1676300627657' in zk 2023-02-13 15:03:50,495 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 15:03:50,495 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 15:03:50,495 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,495 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:50,495 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,43083,1676300627629' in zk 2023-02-13 15:03:50,496 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 15:03:50,496 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:50,496 DEBUG [member: 'jenkins-hbase20.apache.org,33655,1676300627657' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 15:03:50,497 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,497 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 15:03:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:50,498 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:50,498 DEBUG [member: 'jenkins-hbase20.apache.org,43083,1676300627629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 15:03:50,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:50,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:50,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:50,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase20.apache.org,43083,1676300627629': 2023-02-13 15:03:50,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43083,1676300627629' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-13 15:03:50,501 INFO [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-13 15:03:50,501 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:50,501 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:50,501 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,501 INFO [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 15:03:50,503 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:50,503 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,503 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:50,503 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:50,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,504 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,505 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:50,505 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,507 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:50,507 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:50,507 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:50,507 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,507 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:50,507 DEBUG [(jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:50,507 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:50,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-13 15:03:50,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 15:03:50,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:50,507 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:50,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:50,508 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 15:03:50,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:50,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:50,609 DEBUG [Listener at localhost.localdomain/35579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 15:03:50,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 15:03:50,615 INFO [Listener at localhost.localdomain/35579] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676300629952 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:50,616 DEBUG [Listener at localhost.localdomain/35579] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:37333/user/jenkins/test-data/dba0b06b-3f50-e630-4b0c-0a8adca957b6/foo/efbb5b2e-5326-4125-8451-9b7e0d41042e/data/default/testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,616 INFO [Listener at localhost.localdomain/35579] snapshot.RestoreSnapshotHelper(239): region to add: 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:50,616 INFO [Listener at localhost.localdomain/35579] snapshot.RestoreSnapshotHelper(585): clone region=5478f7ab31cf990843e26080344a5434 as 5478f7ab31cf990843e26080344a5434 in snapshot foo 2023-02-13 15:03:50,617 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5478f7ab31cf990843e26080344a5434, NAME => 'testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37333/user/jenkins/test-data/dba0b06b-3f50-e630-4b0c-0a8adca957b6/foo/efbb5b2e-5326-4125-8451-9b7e0d41042e 2023-02-13 15:03:50,624 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:50,624 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 17f6f5f361b041b8a711e8112e54d2f1 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,626 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 37e98d604a3a4ed289a55fdf191b4e41 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5478f7ab31cf990843e26080344a5434, disabling compactions & flushes 2023-02-13 15:03:50,628 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. after waiting 0 ms 2023-02-13 15:03:50,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,628 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5478f7ab31cf990843e26080344a5434: Waiting for close lock at 1676300630628Disabling compacts and flushes for region at 1676300630628Disabling writes for close at 1676300630628Writing region close event to WAL at 1676300630628Closed at 1676300630628 2023-02-13 15:03:50,629 INFO [Listener at localhost.localdomain/35579] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676300629952 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:50,629 DEBUG [Listener at localhost.localdomain/35579] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:37333/user/jenkins/test-data/dba0b06b-3f50-e630-4b0c-0a8adca957b6/foo/efbb5b2e-5326-4125-8451-9b7e0d41042e 2023-02-13 15:03:50,629 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:37333/user/jenkins/test-data/dba0b06b-3f50-e630-4b0c-0a8adca957b6/foo/efbb5b2e-5326-4125-8451-9b7e0d41042e 2023-02-13 15:03:50,629 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(699): |-data/ 2023-02-13 15:03:50,630 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(699): |----default/ 2023-02-13 15:03:50,630 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-13 15:03:50,631 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(699): |----------5478f7ab31cf990843e26080344a5434/ 2023-02-13 15:03:50,631 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:50,631 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:50,632 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=5478f7ab31cf990843e26080344a5434-17f6f5f361b041b8a711e8112e54d2f1 2023-02-13 15:03:50,632 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:50,632 DEBUG [Listener at localhost.localdomain/35579] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=5478f7ab31cf990843e26080344a5434-37e98d604a3a4ed289a55fdf191b4e41 2023-02-13 15:03:50,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-13 15:03:50,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 15:03:50,637 INFO [Listener at localhost.localdomain/35579] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,642 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300630641"}]},"ts":"1676300630641"} 2023-02-13 15:03:50,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:03:50,643 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-13 15:03:50,644 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-13 15:03:50,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5478f7ab31cf990843e26080344a5434, UNASSIGN}] 2023-02-13 15:03:50,646 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5478f7ab31cf990843e26080344a5434, UNASSIGN 2023-02-13 15:03:50,647 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5478f7ab31cf990843e26080344a5434, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:50,647 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676300630647"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300630647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300630647"}]},"ts":"1676300630647"} 2023-02-13 15:03:50,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 5478f7ab31cf990843e26080344a5434, server=jenkins-hbase20.apache.org,43083,1676300627629}] 2023-02-13 15:03:50,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:03:50,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:50,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5478f7ab31cf990843e26080344a5434, disabling compactions & flushes 2023-02-13 15:03:50,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. after waiting 0 ms 2023-02-13 15:03:50,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:50,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434. 2023-02-13 15:03:50,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5478f7ab31cf990843e26080344a5434: Waiting for close lock at 1676300630802Running coprocessor pre-close hooks at 1676300630802Disabling compacts and flushes for region at 1676300630802Disabling writes for close at 1676300630802Writing region close event to WAL at 1676300630803 (+1 ms)Running coprocessor post-close hooks at 1676300630806 (+3 ms)Closed at 1676300630806 2023-02-13 15:03:50,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:50,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5478f7ab31cf990843e26080344a5434, regionState=CLOSED 2023-02-13 15:03:50,808 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676300630808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300630808"}]},"ts":"1676300630808"} 2023-02-13 15:03:50,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 15:03:50,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 5478f7ab31cf990843e26080344a5434, server=jenkins-hbase20.apache.org,43083,1676300627629 in 160 msec 2023-02-13 15:03:50,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 15:03:50,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5478f7ab31cf990843e26080344a5434, UNASSIGN in 166 msec 2023-02-13 15:03:50,813 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300630812"}]},"ts":"1676300630812"} 2023-02-13 15:03:50,814 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-13 15:03:50,815 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-13 15:03:50,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-13 15:03:50,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:03:50,945 INFO [Listener at localhost.localdomain/35579] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-13 15:03:50,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,949 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:03:50,952 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:50,953 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1, FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2, FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/recovered.edits] 2023-02-13 15:03:50,957 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/17f6f5f361b041b8a711e8112e54d2f1 to hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/archive/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/17f6f5f361b041b8a711e8112e54d2f1 2023-02-13 15:03:50,958 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/4edab8bfbd7f427a995a73d34055b53d to hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/archive/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f1/4edab8bfbd7f427a995a73d34055b53d 2023-02-13 15:03:50,960 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/37e98d604a3a4ed289a55fdf191b4e41 to hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/archive/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/37e98d604a3a4ed289a55fdf191b4e41 2023-02-13 15:03:50,961 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/c5b6ba6431ea48f1a884963b3cea846f to hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/archive/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/f2/c5b6ba6431ea48f1a884963b3cea846f 2023-02-13 15:03:50,964 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/recovered.edits/12.seqid to hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/archive/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434/recovered.edits/12.seqid 2023-02-13 15:03:50,964 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5478f7ab31cf990843e26080344a5434 2023-02-13 15:03:50,964 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 15:03:50,966 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,967 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-13 15:03:50,969 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-13 15:03:50,970 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,970 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-13 15:03:50,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300630971"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:50,972 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 15:03:50,972 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5478f7ab31cf990843e26080344a5434, NAME => 'testInitTableSnapshotMapperJobConfig,,1676300628902.5478f7ab31cf990843e26080344a5434.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 15:03:50,972 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-13 15:03:50,972 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676300630972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:50,976 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-13 15:03:50,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 15:03:50,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 31 msec 2023-02-13 15:03:51,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:03:51,052 INFO [Listener at localhost.localdomain/35579] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-13 15:03:51,052 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 15:03:51,052 INFO [Listener at localhost.localdomain/35579] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 15:03:51,052 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7426de7d to 127.0.0.1:52919 2023-02-13 15:03:51,052 DEBUG [Listener at localhost.localdomain/35579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:51,052 DEBUG [Listener at localhost.localdomain/35579] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 15:03:51,052 DEBUG [Listener at localhost.localdomain/35579] util.JVMClusterUtil(257): Found active master hash=926696701, stopped=false 2023-02-13 15:03:51,052 INFO [Listener at localhost.localdomain/35579] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:51,053 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:51,053 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:51,053 INFO [Listener at localhost.localdomain/35579] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 15:03:51,053 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:51,054 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:51,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:51,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:51,055 DEBUG [Listener at localhost.localdomain/35579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04eed2c3 to 127.0.0.1:52919 2023-02-13 15:03:51,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:51,055 DEBUG [Listener at localhost.localdomain/35579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:51,055 INFO [Listener at localhost.localdomain/35579] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,43083,1676300627629' ***** 2023-02-13 15:03:51,055 INFO [Listener at localhost.localdomain/35579] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:51,055 INFO [Listener at localhost.localdomain/35579] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33655,1676300627657' ***** 2023-02-13 15:03:51,055 INFO [Listener at localhost.localdomain/35579] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:51,055 INFO [RS:0;jenkins-hbase20:43083] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:51,055 INFO [RS:1;jenkins-hbase20:33655] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:51,055 INFO [RS:0;jenkins-hbase20:43083] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:51,056 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:51,056 INFO [RS:1;jenkins-hbase20:33655] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:51,056 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:51,056 INFO [RS:1;jenkins-hbase20:33655] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:51,056 INFO [RS:0;jenkins-hbase20:43083] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:51,057 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(3304): Received CLOSE for a4676175977fc278284f6915dacdf010 2023-02-13 15:03:51,057 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:51,057 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:51,057 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:51,057 DEBUG [RS:0;jenkins-hbase20:43083] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ffcb577 to 127.0.0.1:52919 2023-02-13 15:03:51,057 DEBUG [RS:0;jenkins-hbase20:43083] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:51,057 INFO [RS:0;jenkins-hbase20:43083] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:51,058 INFO [RS:0;jenkins-hbase20:43083] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:51,058 INFO [RS:0;jenkins-hbase20:43083] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:51,058 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 15:03:51,058 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:51,058 DEBUG [RS:1;jenkins-hbase20:33655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f10dabc to 127.0.0.1:52919 2023-02-13 15:03:51,059 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:03:51,059 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 15:03:51,059 DEBUG [RS:1;jenkins-hbase20:33655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:51,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing a4676175977fc278284f6915dacdf010, disabling compactions & flushes 2023-02-13 15:03:51,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:51,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:51,060 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:03:51,060 DEBUG [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 15:03:51,060 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:51,060 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1479): Online Regions={a4676175977fc278284f6915dacdf010=hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010.} 2023-02-13 15:03:51,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. after waiting 0 ms 2023-02-13 15:03:51,060 DEBUG [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1505): Waiting on a4676175977fc278284f6915dacdf010 2023-02-13 15:03:51,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:51,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:51,060 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:51,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing a4676175977fc278284f6915dacdf010 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 15:03:51,060 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:51,060 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:51,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-13 15:03:51,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/.tmp/info/1d4aebedd6994658be982dfbf95d127d 2023-02-13 15:03:51,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/.tmp/info/1d4aebedd6994658be982dfbf95d127d as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/info/1d4aebedd6994658be982dfbf95d127d 2023-02-13 15:03:51,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/.tmp/info/eea43a9238124f6a8c185a2ab65811bd 2023-02-13 15:03:51,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eea43a9238124f6a8c185a2ab65811bd 2023-02-13 15:03:51,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/info/1d4aebedd6994658be982dfbf95d127d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 15:03:51,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a4676175977fc278284f6915dacdf010 in 36ms, sequenceid=6, compaction requested=false 2023-02-13 15:03:51,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/namespace/a4676175977fc278284f6915dacdf010/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 15:03:51,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:51,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for a4676175977fc278284f6915dacdf010: Waiting for close lock at 1676300631059Running coprocessor pre-close hooks at 1676300631059Disabling compacts and flushes for region at 1676300631059Disabling writes for close at 1676300631060 (+1 ms)Obtaining lock to block concurrent updates at 1676300631060Preparing flush snapshotting stores in a4676175977fc278284f6915dacdf010 at 1676300631060Finished memstore snapshotting hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676300631061 (+1 ms)Flushing stores of hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. at 1676300631063 (+2 ms)Flushing a4676175977fc278284f6915dacdf010/info: creating writer at 1676300631063Flushing a4676175977fc278284f6915dacdf010/info: appending metadata at 1676300631065 (+2 ms)Flushing a4676175977fc278284f6915dacdf010/info: closing flushed file at 1676300631065Flushing a4676175977fc278284f6915dacdf010/info: reopening flushed file at 1676300631088 (+23 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a4676175977fc278284f6915dacdf010 in 36ms, sequenceid=6, compaction requested=false at 1676300631096 (+8 ms)Writing region close event to WAL at 1676300631096Running coprocessor post-close hooks at 1676300631100 (+4 ms)Closed at 1676300631100 2023-02-13 15:03:51,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676300628234.a4676175977fc278284f6915dacdf010. 2023-02-13 15:03:51,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/.tmp/rep_barrier/f93d40b430164522962e1fc77dd9bc98 2023-02-13 15:03:51,105 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f93d40b430164522962e1fc77dd9bc98 2023-02-13 15:03:51,112 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/.tmp/table/3fab883bfcec494bb42db4593afff0b8 2023-02-13 15:03:51,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fab883bfcec494bb42db4593afff0b8 2023-02-13 15:03:51,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/.tmp/info/eea43a9238124f6a8c185a2ab65811bd as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/info/eea43a9238124f6a8c185a2ab65811bd 2023-02-13 15:03:51,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eea43a9238124f6a8c185a2ab65811bd 2023-02-13 15:03:51,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/info/eea43a9238124f6a8c185a2ab65811bd, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 15:03:51,122 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/.tmp/rep_barrier/f93d40b430164522962e1fc77dd9bc98 as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/rep_barrier/f93d40b430164522962e1fc77dd9bc98 2023-02-13 15:03:51,126 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f93d40b430164522962e1fc77dd9bc98 2023-02-13 15:03:51,126 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/rep_barrier/f93d40b430164522962e1fc77dd9bc98, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 15:03:51,127 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/.tmp/table/3fab883bfcec494bb42db4593afff0b8 as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/table/3fab883bfcec494bb42db4593afff0b8 2023-02-13 15:03:51,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fab883bfcec494bb42db4593afff0b8 2023-02-13 15:03:51,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/table/3fab883bfcec494bb42db4593afff0b8, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 15:03:51,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4345, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 73ms, sequenceid=21, compaction requested=false 2023-02-13 15:03:51,138 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 15:03:51,138 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:03:51,139 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:51,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300631059Running coprocessor pre-close hooks at 1676300631059Disabling compacts and flushes for region at 1676300631059Disabling writes for close at 1676300631060 (+1 ms)Obtaining lock to block concurrent updates at 1676300631061 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676300631061Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4345, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676300631061Flushing stores of hbase:meta,,1.1588230740 at 1676300631063 (+2 ms)Flushing 1588230740/info: creating writer at 1676300631063Flushing 1588230740/info: appending metadata at 1676300631066 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676300631066Flushing 1588230740/rep_barrier: creating writer at 1676300631093 (+27 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676300631096 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676300631096Flushing 1588230740/table: creating writer at 1676300631105 (+9 ms)Flushing 1588230740/table: appending metadata at 1676300631107 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676300631107Flushing 1588230740/info: reopening flushed file at 1676300631117 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676300631123 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676300631128 (+5 ms)Finished flush of dataSize ~4.24 KB/4345, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 73ms, sequenceid=21, compaction requested=false at 1676300631133 (+5 ms)Writing region close event to WAL at 1676300631135 (+2 ms)Running coprocessor post-close hooks at 1676300631138 (+3 ms)Closed at 1676300631139 (+1 ms) 2023-02-13 15:03:51,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:51,260 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,43083,1676300627629; all regions closed. 2023-02-13 15:03:51,260 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33655,1676300627657; all regions closed. 2023-02-13 15:03:51,265 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/WALs/jenkins-hbase20.apache.org,43083,1676300627629/jenkins-hbase20.apache.org%2C43083%2C1676300627629.meta.1676300628165.meta not finished, retry = 0 2023-02-13 15:03:51,267 DEBUG [RS:1;jenkins-hbase20:33655] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/oldWALs 2023-02-13 15:03:51,267 INFO [RS:1;jenkins-hbase20:33655] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33655%2C1676300627657:(num 1676300628600) 2023-02-13 15:03:51,267 DEBUG [RS:1;jenkins-hbase20:33655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:51,268 INFO [RS:1;jenkins-hbase20:33655] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:51,268 INFO [RS:1;jenkins-hbase20:33655] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:51,268 INFO [RS:1;jenkins-hbase20:33655] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:51,268 INFO [RS:1;jenkins-hbase20:33655] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:51,268 INFO [RS:1;jenkins-hbase20:33655] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:51,268 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:51,269 INFO [RS:1;jenkins-hbase20:33655] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33655 2023-02-13 15:03:51,270 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:51,270 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33655,1676300627657 2023-02-13 15:03:51,270 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:51,270 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:51,270 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:51,270 ERROR [Listener at localhost.localdomain/35579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5afbb25d rejected from java.util.concurrent.ThreadPoolExecutor@5ec42dda[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:51,271 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,33655,1676300627657] 2023-02-13 15:03:51,271 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,33655,1676300627657; numProcessing=1 2023-02-13 15:03:51,271 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,33655,1676300627657 already deleted, retry=false 2023-02-13 15:03:51,271 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,33655,1676300627657 expired; onlineServers=1 2023-02-13 15:03:51,368 DEBUG [RS:0;jenkins-hbase20:43083] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/oldWALs 2023-02-13 15:03:51,368 INFO [RS:0;jenkins-hbase20:43083] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43083%2C1676300627629.meta:.meta(num 1676300628165) 2023-02-13 15:03:51,372 DEBUG [RS:0;jenkins-hbase20:43083] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/oldWALs 2023-02-13 15:03:51,372 INFO [RS:0;jenkins-hbase20:43083] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43083%2C1676300627629:(num 1676300628969) 2023-02-13 15:03:51,372 DEBUG [RS:0;jenkins-hbase20:43083] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:51,372 INFO [RS:0;jenkins-hbase20:43083] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:51,373 INFO [RS:0;jenkins-hbase20:43083] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:51,373 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:51,374 INFO [RS:0;jenkins-hbase20:43083] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43083 2023-02-13 15:03:51,374 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43083,1676300627629 2023-02-13 15:03:51,374 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:51,375 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43083,1676300627629] 2023-02-13 15:03:51,375 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43083,1676300627629; numProcessing=2 2023-02-13 15:03:51,376 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43083,1676300627629 already deleted, retry=false 2023-02-13 15:03:51,376 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,43083,1676300627629 expired; onlineServers=0 2023-02-13 15:03:51,376 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44727,1676300627589' ***** 2023-02-13 15:03:51,376 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 15:03:51,376 DEBUG [M:0;jenkins-hbase20:44727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3303d6c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:51,377 INFO [M:0;jenkins-hbase20:44727] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44727,1676300627589 2023-02-13 15:03:51,377 INFO [M:0;jenkins-hbase20:44727] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44727,1676300627589; all regions closed. 2023-02-13 15:03:51,377 DEBUG [M:0;jenkins-hbase20:44727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:51,377 DEBUG [M:0;jenkins-hbase20:44727] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 15:03:51,377 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 15:03:51,377 DEBUG [M:0;jenkins-hbase20:44727] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 15:03:51,377 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300627806] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300627806,5,FailOnTimeoutGroup] 2023-02-13 15:03:51,377 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300627806] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300627806,5,FailOnTimeoutGroup] 2023-02-13 15:03:51,377 INFO [M:0;jenkins-hbase20:44727] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 15:03:51,378 INFO [M:0;jenkins-hbase20:44727] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 15:03:51,378 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:51,378 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:51,378 INFO [M:0;jenkins-hbase20:44727] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 15:03:51,378 DEBUG [M:0;jenkins-hbase20:44727] master.HMaster(1502): Stopping service threads 2023-02-13 15:03:51,378 INFO [M:0;jenkins-hbase20:44727] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 15:03:51,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:51,379 ERROR [M:0;jenkins-hbase20:44727] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 15:03:51,379 INFO [M:0;jenkins-hbase20:44727] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 15:03:51,379 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 15:03:51,379 DEBUG [M:0;jenkins-hbase20:44727] zookeeper.ZKUtil(398): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 15:03:51,380 WARN [M:0;jenkins-hbase20:44727] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 15:03:51,380 INFO [M:0;jenkins-hbase20:44727] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 15:03:51,380 INFO [M:0;jenkins-hbase20:44727] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 15:03:51,380 DEBUG [M:0;jenkins-hbase20:44727] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:51,380 INFO [M:0;jenkins-hbase20:44727] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:51,380 DEBUG [M:0;jenkins-hbase20:44727] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:51,381 DEBUG [M:0;jenkins-hbase20:44727] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:51,381 DEBUG [M:0;jenkins-hbase20:44727] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:51,381 INFO [M:0;jenkins-hbase20:44727] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.96 KB heapSize=66.96 KB 2023-02-13 15:03:51,390 INFO [M:0;jenkins-hbase20:44727] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.96 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5ed7aab1d89411fb88ebba28b63da7b 2023-02-13 15:03:51,394 DEBUG [M:0;jenkins-hbase20:44727] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5ed7aab1d89411fb88ebba28b63da7b as hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5ed7aab1d89411fb88ebba28b63da7b 2023-02-13 15:03:51,397 INFO [M:0;jenkins-hbase20:44727] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37333/user/jenkins/test-data/faa93066-3c1d-33b4-279b-4509d0977adc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5ed7aab1d89411fb88ebba28b63da7b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 15:03:51,398 INFO [M:0;jenkins-hbase20:44727] regionserver.HRegion(2947): Finished flush of dataSize ~55.96 KB/57305, heapSize ~66.95 KB/68552, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-13 15:03:51,399 INFO [M:0;jenkins-hbase20:44727] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:51,399 DEBUG [M:0;jenkins-hbase20:44727] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300631380Disabling compacts and flushes for region at 1676300631380Disabling writes for close at 1676300631381 (+1 ms)Obtaining lock to block concurrent updates at 1676300631381Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676300631381Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57305, getHeapSize=68552, getOffHeapSize=0, getCellsCount=145 at 1676300631381Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676300631382 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676300631382Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676300631385 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676300631385Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676300631395 (+10 ms)Finished flush of dataSize ~55.96 KB/57305, heapSize ~66.95 KB/68552, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676300631398 (+3 ms)Writing region close event to WAL at 1676300631399 (+1 ms)Closed at 1676300631399 2023-02-13 15:03:51,402 INFO [M:0;jenkins-hbase20:44727] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 15:03:51,402 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:51,403 INFO [M:0;jenkins-hbase20:44727] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44727 2023-02-13 15:03:51,403 DEBUG [M:0;jenkins-hbase20:44727] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44727,1676300627589 already deleted, retry=false 2023-02-13 15:03:51,557 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:51,557 INFO [M:0;jenkins-hbase20:44727] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44727,1676300627589; zookeeper connection closed. 2023-02-13 15:03:51,557 ERROR [Listener at localhost.localdomain/35579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e71688f rejected from java.util.concurrent.ThreadPoolExecutor@3a4efb99[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:51,559 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): master:44727-0x1015c5d70240000, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:51,559 ERROR [Listener at localhost.localdomain/35579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7bf9946c rejected from java.util.concurrent.ThreadPoolExecutor@3a4efb99[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:51,657 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:51,657 INFO [RS:0;jenkins-hbase20:43083] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,43083,1676300627629; zookeeper connection closed. 2023-02-13 15:03:51,657 ERROR [Listener at localhost.localdomain/35579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43c9293 rejected from java.util.concurrent.ThreadPoolExecutor@306cc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:51,658 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5149027e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5149027e 2023-02-13 15:03:51,658 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:43083-0x1015c5d70240001, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:51,658 ERROR [Listener at localhost.localdomain/35579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14469b39 rejected from java.util.concurrent.ThreadPoolExecutor@306cc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:51,758 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:51,758 INFO [RS:1;jenkins-hbase20:33655] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33655,1676300627657; zookeeper connection closed. 2023-02-13 15:03:51,758 ERROR [Listener at localhost.localdomain/35579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d79b4a2 rejected from java.util.concurrent.ThreadPoolExecutor@5ec42dda[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:51,758 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c8432c4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c8432c4 2023-02-13 15:03:51,758 DEBUG [Listener at localhost.localdomain/35579-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x1015c5d70240002, quorum=127.0.0.1:52919, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:51,758 ERROR [Listener at localhost.localdomain/35579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5542d06f rejected from java.util.concurrent.ThreadPoolExecutor@5ec42dda[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:51,758 INFO [Listener at localhost.localdomain/35579] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 15:03:51,759 WARN [Listener at localhost.localdomain/35579] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:51,765 INFO [Listener at localhost.localdomain/35579] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:51,870 WARN [BP-142022870-148.251.75.209-1676300627075 heartbeating to localhost.localdomain/127.0.0.1:37333] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:51,870 WARN [BP-142022870-148.251.75.209-1676300627075 heartbeating to localhost.localdomain/127.0.0.1:37333] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-142022870-148.251.75.209-1676300627075 (Datanode Uuid 0faff577-f2a3-44c6-8201-02269017e2af) service to localhost.localdomain/127.0.0.1:37333 2023-02-13 15:03:51,871 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88/dfs/data/data3/current/BP-142022870-148.251.75.209-1676300627075] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:51,871 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88/dfs/data/data4/current/BP-142022870-148.251.75.209-1676300627075] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:51,873 WARN [Listener at localhost.localdomain/35579] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:51,877 INFO [Listener at localhost.localdomain/35579] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:51,980 WARN [BP-142022870-148.251.75.209-1676300627075 heartbeating to localhost.localdomain/127.0.0.1:37333] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:51,980 WARN [BP-142022870-148.251.75.209-1676300627075 heartbeating to localhost.localdomain/127.0.0.1:37333] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-142022870-148.251.75.209-1676300627075 (Datanode Uuid 8d5964ad-2286-43bc-a097-a4db919a3ec4) service to localhost.localdomain/127.0.0.1:37333 2023-02-13 15:03:51,980 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88/dfs/data/data1/current/BP-142022870-148.251.75.209-1676300627075] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:51,981 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/cluster_6c1ddbc4-9ef0-237e-7a16-38abe50f8c88/dfs/data/data2/current/BP-142022870-148.251.75.209-1676300627075] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:51,992 INFO [Listener at localhost.localdomain/35579] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 15:03:52,108 INFO [Listener at localhost.localdomain/35579] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 15:03:52,123 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 15:03:52,134 INFO [Listener at localhost.localdomain/35579] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 158) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost.localdomain:37333 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/35579 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:37333 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:37333 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,44727,1676300627589)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:37333 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost.localdomain:37333 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:37333 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:37333 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=570 (was 541) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 196) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=7031 (was 7183) 2023-02-13 15:03:52,143 INFO [Listener at localhost.localdomain/35579] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=570, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=164, AvailableMemoryMB=7030 2023-02-13 15:03:52,151 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/hadoop.log.dir so I do NOT create it in target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719 2023-02-13 15:03:52,151 WARN [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 15:03:52,151 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/hadoop.tmp.dir so I do NOT create it in target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719 2023-02-13 15:03:52,151 WARN [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/320ec02e-819a-6b64-3061-c96ee9e3c024/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 15:03:52,151 DEBUG [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041, deleteOnExit=true 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/test.cache.data in system properties and HBase conf 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/hadoop.log.dir in system properties and HBase conf 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 15:03:52,152 DEBUG [Listener at localhost.localdomain/35579] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 15:03:52,152 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/nfs.dump.dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/java.io.tmpdir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 15:03:52,153 INFO [Listener at localhost.localdomain/35579] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 15:03:52,156 WARN [Listener at localhost.localdomain/35579] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:52,156 WARN [Listener at localhost.localdomain/35579] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:52,181 WARN [Listener at localhost.localdomain/35579] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:52,183 INFO [Listener at localhost.localdomain/35579] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:52,188 INFO [Listener at localhost.localdomain/35579] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/java.io.tmpdir/Jetty_localhost_localdomain_45623_hdfs____.4k9hsg/webapp 2023-02-13 15:03:52,259 INFO [Listener at localhost.localdomain/35579] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45623 2023-02-13 15:03:52,262 WARN [Listener at localhost.localdomain/35579] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:52,262 WARN [Listener at localhost.localdomain/35579] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:52,297 WARN [Listener at localhost.localdomain/42437] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:52,308 WARN [Listener at localhost.localdomain/42437] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:52,310 WARN [Listener at localhost.localdomain/42437] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:52,311 INFO [Listener at localhost.localdomain/42437] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:52,319 INFO [Listener at localhost.localdomain/42437] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/java.io.tmpdir/Jetty_localhost_39855_datanode____.mvdylj/webapp 2023-02-13 15:03:52,396 INFO [Listener at localhost.localdomain/42437] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39855 2023-02-13 15:03:52,402 WARN [Listener at localhost.localdomain/39301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:52,415 WARN [Listener at localhost.localdomain/39301] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:52,417 WARN [Listener at localhost.localdomain/39301] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:52,418 INFO [Listener at localhost.localdomain/39301] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:52,421 INFO [Listener at localhost.localdomain/39301] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/java.io.tmpdir/Jetty_localhost_38145_datanode____wi04lw/webapp 2023-02-13 15:03:52,474 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x27c50cfc7320674a: Processing first storage report for DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6 from datanode 1885fc34-9b48-4552-bfeb-e63b46d5e674 2023-02-13 15:03:52,474 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x27c50cfc7320674a: from storage DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6 node DatanodeRegistration(127.0.0.1:39903, datanodeUuid=1885fc34-9b48-4552-bfeb-e63b46d5e674, infoPort=33595, infoSecurePort=0, ipcPort=39301, storageInfo=lv=-57;cid=testClusterID;nsid=905347127;c=1676300632157), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:52,474 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x27c50cfc7320674a: Processing first storage report for DS-3a1f465f-f6fa-4790-b8c0-a53320273eca from datanode 1885fc34-9b48-4552-bfeb-e63b46d5e674 2023-02-13 15:03:52,474 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x27c50cfc7320674a: from storage DS-3a1f465f-f6fa-4790-b8c0-a53320273eca node DatanodeRegistration(127.0.0.1:39903, datanodeUuid=1885fc34-9b48-4552-bfeb-e63b46d5e674, infoPort=33595, infoSecurePort=0, ipcPort=39301, storageInfo=lv=-57;cid=testClusterID;nsid=905347127;c=1676300632157), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:52,507 INFO [Listener at localhost.localdomain/39301] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38145 2023-02-13 15:03:52,515 WARN [Listener at localhost.localdomain/37059] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:52,587 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x33d37b47cf3cf836: Processing first storage report for DS-ca073c73-1276-437a-819c-dcef13498796 from datanode 5f967cc4-9d90-4bab-86c2-4a3a2a7cb404 2023-02-13 15:03:52,587 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x33d37b47cf3cf836: from storage DS-ca073c73-1276-437a-819c-dcef13498796 node DatanodeRegistration(127.0.0.1:35353, datanodeUuid=5f967cc4-9d90-4bab-86c2-4a3a2a7cb404, infoPort=41859, infoSecurePort=0, ipcPort=37059, storageInfo=lv=-57;cid=testClusterID;nsid=905347127;c=1676300632157), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:52,587 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x33d37b47cf3cf836: Processing first storage report for DS-80f9f637-ff60-4440-a8b7-55cea45adad1 from datanode 5f967cc4-9d90-4bab-86c2-4a3a2a7cb404 2023-02-13 15:03:52,587 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x33d37b47cf3cf836: from storage DS-80f9f637-ff60-4440-a8b7-55cea45adad1 node DatanodeRegistration(127.0.0.1:35353, datanodeUuid=5f967cc4-9d90-4bab-86c2-4a3a2a7cb404, infoPort=41859, infoSecurePort=0, ipcPort=37059, storageInfo=lv=-57;cid=testClusterID;nsid=905347127;c=1676300632157), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:52,627 DEBUG [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719 2023-02-13 15:03:52,628 DEBUG [Listener at localhost.localdomain/37059] zookeeper.MiniZooKeeperCluster(243): Failed binding ZK Server to client port: 57866 java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:461) at sun.nio.ch.Net.bind(Net.java:453) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:78) at org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:687) at org.apache.zookeeper.server.ServerCnxnFactory.configure(ServerCnxnFactory.java:76) at org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster.startup(MiniZooKeeperCluster.java:239) at org.apache.hadoop.hbase.HBaseZKTestingUtility.startMiniZKCluster(HBaseZKTestingUtility.java:129) at org.apache.hadoop.hbase.HBaseZKTestingUtility.startMiniZKCluster(HBaseZKTestingUtility.java:102) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1090) at org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormatTestBase.setupCluster(TableSnapshotInputFormatTestBase.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-13 15:03:52,630 INFO [Listener at localhost.localdomain/37059] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041/zookeeper_0, clientPort=57867, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 15:03:52,631 INFO [Listener at localhost.localdomain/37059] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57867 2023-02-13 15:03:52,631 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,632 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,652 INFO [Listener at localhost.localdomain/37059] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a with version=8 2023-02-13 15:03:52,652 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,654 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,656 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/hbase-staging 2023-02-13 15:03:52,658 INFO [Listener at localhost.localdomain/37059] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:52,658 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,659 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,659 INFO [Listener at localhost.localdomain/37059] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:52,659 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,659 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:52,659 INFO [Listener at localhost.localdomain/37059] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:52,660 INFO [Listener at localhost.localdomain/37059] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33599 2023-02-13 15:03:52,661 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,662 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,663 INFO [Listener at localhost.localdomain/37059] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33599 connecting to ZooKeeper ensemble=127.0.0.1:57867 2023-02-13 15:03:52,673 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:335990x0, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:52,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33599-0x1015c5d83e40000 connected 2023-02-13 15:03:52,709 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:52,710 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:52,710 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:52,715 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33599 2023-02-13 15:03:52,715 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33599 2023-02-13 15:03:52,715 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33599 2023-02-13 15:03:52,723 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33599 2023-02-13 15:03:52,723 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33599 2023-02-13 15:03:52,723 INFO [Listener at localhost.localdomain/37059] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a, hbase.cluster.distributed=false 2023-02-13 15:03:52,735 INFO [Listener at localhost.localdomain/37059] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:52,735 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,735 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,735 INFO [Listener at localhost.localdomain/37059] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:52,735 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,736 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:52,736 INFO [Listener at localhost.localdomain/37059] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:52,736 INFO [Listener at localhost.localdomain/37059] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42649 2023-02-13 15:03:52,737 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:52,738 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:52,739 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,741 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,742 INFO [Listener at localhost.localdomain/37059] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42649 connecting to ZooKeeper ensemble=127.0.0.1:57867 2023-02-13 15:03:52,746 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:426490x0, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:52,747 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): regionserver:426490x0, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:52,748 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): regionserver:426490x0, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:52,748 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): regionserver:426490x0, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:52,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42649-0x1015c5d83e40001 connected 2023-02-13 15:03:52,757 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42649 2023-02-13 15:03:52,758 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42649 2023-02-13 15:03:52,759 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42649 2023-02-13 15:03:52,759 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42649 2023-02-13 15:03:52,761 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42649 2023-02-13 15:03:52,771 INFO [Listener at localhost.localdomain/37059] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:52,772 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,772 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,772 INFO [Listener at localhost.localdomain/37059] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:52,772 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:52,772 INFO [Listener at localhost.localdomain/37059] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:52,772 INFO [Listener at localhost.localdomain/37059] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:52,773 INFO [Listener at localhost.localdomain/37059] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37973 2023-02-13 15:03:52,774 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:52,775 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:52,776 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,777 INFO [Listener at localhost.localdomain/37059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,779 INFO [Listener at localhost.localdomain/37059] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37973 connecting to ZooKeeper ensemble=127.0.0.1:57867 2023-02-13 15:03:52,786 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:379730x0, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:52,788 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): regionserver:379730x0, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:52,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37973-0x1015c5d83e40002 connected 2023-02-13 15:03:52,789 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:52,789 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ZKUtil(164): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:52,798 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37973 2023-02-13 15:03:52,799 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37973 2023-02-13 15:03:52,799 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37973 2023-02-13 15:03:52,801 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37973 2023-02-13 15:03:52,802 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37973 2023-02-13 15:03:52,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:52,805 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:52,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:52,807 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:52,807 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:52,807 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:52,807 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:52,809 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:52,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:52,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,33599,1676300632658 from backup master directory 2023-02-13 15:03:52,811 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:52,811 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:52,811 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:52,811 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:52,827 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/hbase.id with ID: 7f1e69c5-fd2f-4d51-8a4c-29f1384ca7dc 2023-02-13 15:03:52,838 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:52,840 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:52,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4d8f940c to 127.0.0.1:57867 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:52,858 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@242151dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:52,858 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:52,858 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 15:03:52,858 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:52,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store-tmp 2023-02-13 15:03:52,871 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:52,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:52,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:52,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:52,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:52,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:52,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:52,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300632872Disabling compacts and flushes for region at 1676300632872Disabling writes for close at 1676300632872Writing region close event to WAL at 1676300632872Closed at 1676300632872 2023-02-13 15:03:52,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/WALs/jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:52,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33599%2C1676300632658, suffix=, logDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/WALs/jenkins-hbase20.apache.org,33599,1676300632658, archiveDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/oldWALs, maxLogs=10 2023-02-13 15:03:52,887 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK] 2023-02-13 15:03:52,888 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK] 2023-02-13 15:03:52,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/WALs/jenkins-hbase20.apache.org,33599,1676300632658/jenkins-hbase20.apache.org%2C33599%2C1676300632658.1676300632875 2023-02-13 15:03:52,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK], DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK]] 2023-02-13 15:03:52,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:52,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:52,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:52,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:52,895 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:52,896 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 15:03:52,897 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 15:03:52,897 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:52,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:52,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:52,900 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:52,907 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:52,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62345448, jitterRate=-0.07098042964935303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:52,908 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676300632890Initializing all the Stores at 1676300632891 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300632891Cleaning up temporary data from old regions at 1676300632898 (+7 ms)Cleaning up detritus from prior splits at 1676300632899 (+1 ms)Region opened successfully at 1676300632908 (+9 ms) 2023-02-13 15:03:52,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 15:03:52,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 15:03:52,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 15:03:52,913 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 15:03:52,913 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 15:03:52,913 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 15:03:52,914 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 15:03:52,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 15:03:52,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 15:03:52,929 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 15:03:52,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 15:03:52,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 15:03:52,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 15:03:52,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 15:03:52,932 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:52,933 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 15:03:52,933 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 15:03:52,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 15:03:52,935 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:52,935 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:52,935 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:52,935 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:52,935 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,33599,1676300632658, sessionid=0x1015c5d83e40000, setting cluster-up flag (Was=false) 2023-02-13 15:03:52,939 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:52,941 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 15:03:52,941 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:52,943 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:52,945 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 15:03:52,946 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:52,946 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.hbase-snapshot/.tmp 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:52,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:52,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676300662956 2023-02-13 15:03:52,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 15:03:52,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 15:03:52,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 15:03:52,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 15:03:52,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 15:03:52,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 15:03:52,957 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:52,957 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 15:03:52,958 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:52,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 15:03:52,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 15:03:52,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 15:03:52,959 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:52,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 15:03:52,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 15:03:52,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300632959,5,FailOnTimeoutGroup] 2023-02-13 15:03:52,967 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300632960,5,FailOnTimeoutGroup] 2023-02-13 15:03:52,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:52,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 15:03:52,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:52,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:52,974 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:52,975 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:52,975 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a 2023-02-13 15:03:52,981 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:52,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:52,983 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/info 2023-02-13 15:03:52,984 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:52,984 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:52,984 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:52,985 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:52,985 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:52,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:52,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:52,987 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/table 2023-02-13 15:03:52,987 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:52,987 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:52,988 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740 2023-02-13 15:03:52,988 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740 2023-02-13 15:03:52,990 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:52,991 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:52,993 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:52,993 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66590250, jitterRate=-0.007727950811386108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:52,993 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676300632982Initializing all the Stores at 1676300632982Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300632982Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300632982Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300632982Cleaning up temporary data from old regions at 1676300632989 (+7 ms)Cleaning up detritus from prior splits at 1676300632989Region opened successfully at 1676300632993 (+4 ms) 2023-02-13 15:03:52,993 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:52,993 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:52,993 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:52,994 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:52,994 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:52,994 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:52,994 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300632993Disabling compacts and flushes for region at 1676300632993Disabling writes for close at 1676300632994 (+1 ms)Writing region close event to WAL at 1676300632994Closed at 1676300632994 2023-02-13 15:03:52,995 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:52,995 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 15:03:52,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 15:03:52,997 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 15:03:52,999 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 15:03:53,004 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(952): ClusterId : 7f1e69c5-fd2f-4d51-8a4c-29f1384ca7dc 2023-02-13 15:03:53,004 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(952): ClusterId : 7f1e69c5-fd2f-4d51-8a4c-29f1384ca7dc 2023-02-13 15:03:53,005 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:53,005 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:03:53,006 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:53,006 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:03:53,006 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:53,006 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:03:53,007 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:53,008 DEBUG [RS:0;jenkins-hbase20:42649] zookeeper.ReadOnlyZKClient(139): Connect 0x065abe0b to 127.0.0.1:57867 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:53,008 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:03:53,012 DEBUG [RS:1;jenkins-hbase20:37973] zookeeper.ReadOnlyZKClient(139): Connect 0x0517bffb to 127.0.0.1:57867 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:53,016 DEBUG [RS:0;jenkins-hbase20:42649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@89d50b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:53,016 DEBUG [RS:1;jenkins-hbase20:37973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bd04129, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:53,016 DEBUG [RS:0;jenkins-hbase20:42649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ca2d57b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:53,016 DEBUG [RS:1;jenkins-hbase20:37973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fefd48b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:53,024 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:42649 2023-02-13 15:03:53,024 INFO [RS:0;jenkins-hbase20:42649] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:53,024 INFO [RS:0;jenkins-hbase20:42649] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:53,024 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:53,025 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:37973 2023-02-13 15:03:53,025 INFO [RS:1;jenkins-hbase20:37973] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:03:53,025 INFO [RS:1;jenkins-hbase20:37973] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:03:53,025 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33599,1676300632658 with isa=jenkins-hbase20.apache.org/148.251.75.209:42649, startcode=1676300632735 2023-02-13 15:03:53,025 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:03:53,025 DEBUG [RS:0;jenkins-hbase20:42649] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:53,026 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33599,1676300632658 with isa=jenkins-hbase20.apache.org/148.251.75.209:37973, startcode=1676300632771 2023-02-13 15:03:53,026 DEBUG [RS:1;jenkins-hbase20:37973] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:03:53,028 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42997, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:53,028 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53415, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:03:53,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,030 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a 2023-02-13 15:03:53,030 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a 2023-02-13 15:03:53,030 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42437 2023-02-13 15:03:53,031 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:53,031 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42437 2023-02-13 15:03:53,031 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:03:53,032 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:53,032 DEBUG [RS:0;jenkins-hbase20:42649] zookeeper.ZKUtil(162): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,033 WARN [RS:0;jenkins-hbase20:42649] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:53,033 DEBUG [RS:1;jenkins-hbase20:37973] zookeeper.ZKUtil(162): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,033 INFO [RS:0;jenkins-hbase20:42649] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:53,033 WARN [RS:1;jenkins-hbase20:37973] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:53,033 INFO [RS:1;jenkins-hbase20:37973] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:53,033 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,033 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,036 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42649,1676300632735] 2023-02-13 15:03:53,036 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,37973,1676300632771] 2023-02-13 15:03:53,055 DEBUG [RS:1;jenkins-hbase20:37973] zookeeper.ZKUtil(162): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,055 DEBUG [RS:0;jenkins-hbase20:42649] zookeeper.ZKUtil(162): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,055 DEBUG [RS:1;jenkins-hbase20:37973] zookeeper.ZKUtil(162): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,055 DEBUG [RS:0;jenkins-hbase20:42649] zookeeper.ZKUtil(162): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,056 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:53,056 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:03:53,056 INFO [RS:0;jenkins-hbase20:42649] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:53,056 INFO [RS:1;jenkins-hbase20:37973] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:03:53,057 INFO [RS:0;jenkins-hbase20:42649] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:53,059 INFO [RS:0;jenkins-hbase20:42649] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:53,059 INFO [RS:0;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,063 INFO [RS:1;jenkins-hbase20:37973] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:03:53,063 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:53,064 INFO [RS:1;jenkins-hbase20:37973] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:03:53,064 INFO [RS:1;jenkins-hbase20:37973] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,069 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:03:53,069 INFO [RS:0;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,070 DEBUG [RS:0;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,071 INFO [RS:1;jenkins-hbase20:37973] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,075 INFO [RS:0;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 INFO [RS:0;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 INFO [RS:0;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,075 DEBUG [RS:1;jenkins-hbase20:37973] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:53,076 INFO [RS:1;jenkins-hbase20:37973] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,076 INFO [RS:1;jenkins-hbase20:37973] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,076 INFO [RS:1;jenkins-hbase20:37973] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,085 INFO [RS:0;jenkins-hbase20:42649] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:53,085 INFO [RS:0;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42649,1676300632735-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,091 INFO [RS:1;jenkins-hbase20:37973] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:03:53,091 INFO [RS:1;jenkins-hbase20:37973] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37973,1676300632771-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,093 INFO [RS:0;jenkins-hbase20:42649] regionserver.Replication(203): jenkins-hbase20.apache.org,42649,1676300632735 started 2023-02-13 15:03:53,094 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,42649,1676300632735, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42649, sessionid=0x1015c5d83e40001 2023-02-13 15:03:53,094 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:53,094 DEBUG [RS:0;jenkins-hbase20:42649] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,094 DEBUG [RS:0;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42649,1676300632735' 2023-02-13 15:03:53,094 DEBUG [RS:0;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:53,094 DEBUG [RS:0;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:53,094 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:53,095 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:53,095 DEBUG [RS:0;jenkins-hbase20:42649] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,095 DEBUG [RS:0;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42649,1676300632735' 2023-02-13 15:03:53,095 DEBUG [RS:0;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:53,095 DEBUG [RS:0;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:53,095 DEBUG [RS:0;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:53,095 INFO [RS:0;jenkins-hbase20:42649] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:53,095 INFO [RS:0;jenkins-hbase20:42649] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:53,100 INFO [RS:1;jenkins-hbase20:37973] regionserver.Replication(203): jenkins-hbase20.apache.org,37973,1676300632771 started 2023-02-13 15:03:53,100 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,37973,1676300632771, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:37973, sessionid=0x1015c5d83e40002 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37973,1676300632771' 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37973,1676300632771' 2023-02-13 15:03:53,101 DEBUG [RS:1;jenkins-hbase20:37973] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:53,102 DEBUG [RS:1;jenkins-hbase20:37973] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:53,102 DEBUG [RS:1;jenkins-hbase20:37973] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:03:53,102 INFO [RS:1;jenkins-hbase20:37973] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:03:53,102 INFO [RS:1;jenkins-hbase20:37973] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:03:53,149 DEBUG [jenkins-hbase20:33599] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 15:03:53,149 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:53,151 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:53,151 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:53,151 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:53,152 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37973,1676300632771, state=OPENING 2023-02-13 15:03:53,153 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 15:03:53,153 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:53,154 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:53,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:53,308 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:53,308 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:53,310 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:53,314 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 15:03:53,314 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:53,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37973%2C1676300632771.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,37973,1676300632771, archiveDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/oldWALs, maxLogs=32 2023-02-13 15:03:53,330 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK] 2023-02-13 15:03:53,330 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK] 2023-02-13 15:03:53,332 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,37973,1676300632771/jenkins-hbase20.apache.org%2C37973%2C1676300632771.meta.1676300633316.meta 2023-02-13 15:03:53,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK], DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK]] 2023-02-13 15:03:53,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:53,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 15:03:53,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 15:03:53,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 15:03:53,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 15:03:53,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:53,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 15:03:53,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 15:03:53,335 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:03:53,336 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/info 2023-02-13 15:03:53,336 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/info 2023-02-13 15:03:53,336 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:03:53,337 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:53,337 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:03:53,338 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:53,338 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:03:53,338 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:03:53,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:53,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:03:53,339 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/table 2023-02-13 15:03:53,339 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/table 2023-02-13 15:03:53,339 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:03:53,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:53,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740 2023-02-13 15:03:53,341 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740 2023-02-13 15:03:53,343 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:03:53,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:03:53,345 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60033681, jitterRate=-0.10542844235897064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:03:53,345 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676300633334Writing region info on filesystem at 1676300633334Initializing all the Stores at 1676300633334Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300633334Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300633335 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300633335Cleaning up temporary data from old regions at 1676300633342 (+7 ms)Cleaning up detritus from prior splits at 1676300633343 (+1 ms)Running coprocessor post-open hooks at 1676300633345 (+2 ms)Region opened successfully at 1676300633345 2023-02-13 15:03:53,345 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676300633308 2023-02-13 15:03:53,351 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 15:03:53,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 15:03:53,353 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37973,1676300632771, state=OPEN 2023-02-13 15:03:53,354 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 15:03:53,354 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:03:53,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 15:03:53,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37973,1676300632771 in 200 msec 2023-02-13 15:03:53,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 15:03:53,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-02-13 15:03:53,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 410 msec 2023-02-13 15:03:53,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676300632806, completionTime=-1 2023-02-13 15:03:53,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 15:03:53,358 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 15:03:53,363 DEBUG [hconnection-0x64be5457-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:53,365 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56274, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:53,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 15:03:53,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676300693367 2023-02-13 15:03:53,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676300753367 2023-02-13 15:03:53,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 9 msec 2023-02-13 15:03:53,373 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1676300632658-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1676300632658-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1676300632658-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:33599, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:53,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 15:03:53,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:53,375 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 15:03:53,377 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 15:03:53,377 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:53,378 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:53,380 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,381 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77 empty. 2023-02-13 15:03:53,381 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,381 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 15:03:53,398 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:53,400 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 89013eb05de382ef59dc89f08be7dd77, NAME => 'hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:53,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:53,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 89013eb05de382ef59dc89f08be7dd77, disabling compactions & flushes 2023-02-13 15:03:53,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:53,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:53,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. after waiting 0 ms 2023-02-13 15:03:53,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:53,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:53,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 89013eb05de382ef59dc89f08be7dd77: Waiting for close lock at 1676300633410Disabling compacts and flushes for region at 1676300633410Disabling writes for close at 1676300633410Writing region close event to WAL at 1676300633410Closed at 1676300633410 2023-02-13 15:03:53,413 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:53,414 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300633414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300633414"}]},"ts":"1676300633414"} 2023-02-13 15:03:53,416 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:03:53,417 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:53,417 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300633417"}]},"ts":"1676300633417"} 2023-02-13 15:03:53,419 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 15:03:53,421 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:53,422 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:53,422 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:53,422 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:53,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=89013eb05de382ef59dc89f08be7dd77, ASSIGN}] 2023-02-13 15:03:53,428 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=89013eb05de382ef59dc89f08be7dd77, ASSIGN 2023-02-13 15:03:53,428 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=89013eb05de382ef59dc89f08be7dd77, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42649,1676300632735; forceNewPlan=false, retain=false 2023-02-13 15:03:53,579 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:03:53,580 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=89013eb05de382ef59dc89f08be7dd77, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,580 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300633580"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300633580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300633580"}]},"ts":"1676300633580"} 2023-02-13 15:03:53,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 89013eb05de382ef59dc89f08be7dd77, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:53,690 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 15:03:53,736 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,736 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:03:53,738 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42886, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:03:53,743 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:53,745 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42649%2C1676300632735, suffix=, logDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,42649,1676300632735, archiveDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/oldWALs, maxLogs=32 2023-02-13 15:03:53,773 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK] 2023-02-13 15:03:53,773 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK] 2023-02-13 15:03:53,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,42649,1676300632735/jenkins-hbase20.apache.org%2C42649%2C1676300632735.1676300633746 2023-02-13 15:03:53,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK], DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK]] 2023-02-13 15:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 89013eb05de382ef59dc89f08be7dd77, NAME => 'hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,777 INFO [StoreOpener-89013eb05de382ef59dc89f08be7dd77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,780 DEBUG [StoreOpener-89013eb05de382ef59dc89f08be7dd77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/info 2023-02-13 15:03:53,780 DEBUG [StoreOpener-89013eb05de382ef59dc89f08be7dd77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/info 2023-02-13 15:03:53,781 INFO [StoreOpener-89013eb05de382ef59dc89f08be7dd77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89013eb05de382ef59dc89f08be7dd77 columnFamilyName info 2023-02-13 15:03:53,782 INFO [StoreOpener-89013eb05de382ef59dc89f08be7dd77-1] regionserver.HStore(310): Store=89013eb05de382ef59dc89f08be7dd77/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:53,783 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,783 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:53,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:53,788 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 89013eb05de382ef59dc89f08be7dd77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71499524, jitterRate=0.06542593240737915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:53,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 89013eb05de382ef59dc89f08be7dd77: Running coprocessor pre-open hook at 1676300633776Writing region info on filesystem at 1676300633776Initializing all the Stores at 1676300633777 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300633777Cleaning up temporary data from old regions at 1676300633784 (+7 ms)Cleaning up detritus from prior splits at 1676300633784Running coprocessor post-open hooks at 1676300633788 (+4 ms)Region opened successfully at 1676300633788 2023-02-13 15:03:53,789 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77., pid=6, masterSystemTime=1676300633736 2023-02-13 15:03:53,794 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:53,795 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:53,795 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=89013eb05de382ef59dc89f08be7dd77, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:53,795 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300633795"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300633795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300633795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300633795"}]},"ts":"1676300633795"} 2023-02-13 15:03:53,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 15:03:53,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 89013eb05de382ef59dc89f08be7dd77, server=jenkins-hbase20.apache.org,42649,1676300632735 in 215 msec 2023-02-13 15:03:53,800 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 15:03:53,800 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=89013eb05de382ef59dc89f08be7dd77, ASSIGN in 376 msec 2023-02-13 15:03:53,801 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:53,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300633801"}]},"ts":"1676300633801"} 2023-02-13 15:03:53,816 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 15:03:53,818 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:53,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 444 msec 2023-02-13 15:03:53,876 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 15:03:53,882 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:53,882 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:53,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:53,886 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:53,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 15:03:53,898 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:53,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-13 15:03:53,911 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 15:03:53,917 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:03:53,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 15:03:53,924 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 15:03:53,925 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 15:03:53,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.114sec 2023-02-13 15:03:53,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 15:03:53,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 15:03:53,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 15:03:53,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1676300632658-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 15:03:53,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1676300632658-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 15:03:53,927 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 15:03:54,015 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ReadOnlyZKClient(139): Connect 0x7ab3a11d to 127.0.0.1:57867 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:54,021 DEBUG [Listener at localhost.localdomain/37059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b9b9ee3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:54,022 DEBUG [hconnection-0x76f65e73-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:54,024 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:54,026 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:54,026 DEBUG [Listener at localhost.localdomain/37059] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 15:03:54,028 DEBUG [Listener at localhost.localdomain/37059] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 15:03:54,032 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50350, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 15:03:54,033 INFO [Listener at localhost.localdomain/37059] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:03:54,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 148.251.75.209:50350 deadline: 1676300694034, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,035 INFO [Listener at localhost.localdomain/37059] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-13 15:03:54,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:54,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:03:54,043 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-13 15:03:54,044 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:03:54,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,053 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09 empty. 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f empty. 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2 empty. 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9 empty. 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a empty. 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f empty. 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,054 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6 empty. 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9 empty. 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b empty. 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58 empty. 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,055 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,056 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,056 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 15:03:54,070 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:54,071 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 900c7d4f37133b0b975bf94983743ed9, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,072 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3b25ff1d552763fac8d24645cf323a09, NAME => 'testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,072 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e34c258292c61e5a3f7b1f3e0ae0bdb2, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,085 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,086 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 900c7d4f37133b0b975bf94983743ed9, disabling compactions & flushes 2023-02-13 15:03:54,086 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,086 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,086 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. after waiting 0 ms 2023-02-13 15:03:54,086 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,086 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,086 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 900c7d4f37133b0b975bf94983743ed9: Waiting for close lock at 1676300634085Disabling compacts and flushes for region at 1676300634085Disabling writes for close at 1676300634086 (+1 ms)Writing region close event to WAL at 1676300634086Closed at 1676300634086 2023-02-13 15:03:54,086 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 410d925effc6aa195d66785a9f0b011a, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,087 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,088 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e34c258292c61e5a3f7b1f3e0ae0bdb2, disabling compactions & flushes 2023-02-13 15:03:54,088 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,088 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,088 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. after waiting 0 ms 2023-02-13 15:03:54,088 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,088 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,088 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: Waiting for close lock at 1676300634088Disabling compacts and flushes for region at 1676300634088Disabling writes for close at 1676300634088Writing region close event to WAL at 1676300634088Closed at 1676300634088 2023-02-13 15:03:54,088 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => ad04c80fd3e621f78ed2f74eba56670b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,089 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,089 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3b25ff1d552763fac8d24645cf323a09, disabling compactions & flushes 2023-02-13 15:03:54,089 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,089 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,089 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. after waiting 0 ms 2023-02-13 15:03:54,089 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,089 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,089 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3b25ff1d552763fac8d24645cf323a09: Waiting for close lock at 1676300634089Disabling compacts and flushes for region at 1676300634089Disabling writes for close at 1676300634089Writing region close event to WAL at 1676300634089Closed at 1676300634089 2023-02-13 15:03:54,089 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 34f648530b1105ec25f211671a058a0f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 410d925effc6aa195d66785a9f0b011a, disabling compactions & flushes 2023-02-13 15:03:54,100 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. after waiting 0 ms 2023-02-13 15:03:54,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,100 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 410d925effc6aa195d66785a9f0b011a: Waiting for close lock at 1676300634100Disabling compacts and flushes for region at 1676300634100Disabling writes for close at 1676300634100Writing region close event to WAL at 1676300634100Closed at 1676300634100 2023-02-13 15:03:54,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 445d6c9e05b4f7c96ae0031b5ccefc4f, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 34f648530b1105ec25f211671a058a0f, disabling compactions & flushes 2023-02-13 15:03:54,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. after waiting 0 ms 2023-02-13 15:03:54,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 34f648530b1105ec25f211671a058a0f: Waiting for close lock at 1676300634101Disabling compacts and flushes for region at 1676300634101Disabling writes for close at 1676300634101Writing region close event to WAL at 1676300634101Closed at 1676300634101 2023-02-13 15:03:54,102 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 65ded8d6d3cd268fe403bceb06ac67e9, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,102 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,103 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing ad04c80fd3e621f78ed2f74eba56670b, disabling compactions & flushes 2023-02-13 15:03:54,103 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,103 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,103 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. after waiting 0 ms 2023-02-13 15:03:54,103 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,103 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,103 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for ad04c80fd3e621f78ed2f74eba56670b: Waiting for close lock at 1676300634103Disabling compacts and flushes for region at 1676300634103Disabling writes for close at 1676300634103Writing region close event to WAL at 1676300634103Closed at 1676300634103 2023-02-13 15:03:54,103 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8573c998975004b464501ca9fe5d93c6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,104 INFO [RS:1;jenkins-hbase20:37973] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37973%2C1676300632771, suffix=, logDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,37973,1676300632771, archiveDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/oldWALs, maxLogs=32 2023-02-13 15:03:54,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 445d6c9e05b4f7c96ae0031b5ccefc4f, disabling compactions & flushes 2023-02-13 15:03:54,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. after waiting 0 ms 2023-02-13 15:03:54,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: Waiting for close lock at 1676300634115Disabling compacts and flushes for region at 1676300634115Disabling writes for close at 1676300634115Writing region close event to WAL at 1676300634115Closed at 1676300634115 2023-02-13 15:03:54,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 43d37b28ba2ca53cc46d9a3eb2cf8f58, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp 2023-02-13 15:03:54,125 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK] 2023-02-13 15:03:54,125 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK] 2023-02-13 15:03:54,126 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,126 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8573c998975004b464501ca9fe5d93c6, disabling compactions & flushes 2023-02-13 15:03:54,126 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,126 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,126 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. after waiting 0 ms 2023-02-13 15:03:54,126 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,129 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,129 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8573c998975004b464501ca9fe5d93c6: Waiting for close lock at 1676300634126Disabling compacts and flushes for region at 1676300634126Disabling writes for close at 1676300634126Writing region close event to WAL at 1676300634129 (+3 ms)Closed at 1676300634129 2023-02-13 15:03:54,129 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,130 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 65ded8d6d3cd268fe403bceb06ac67e9, disabling compactions & flushes 2023-02-13 15:03:54,130 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,130 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,130 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. after waiting 0 ms 2023-02-13 15:03:54,130 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,130 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,130 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 65ded8d6d3cd268fe403bceb06ac67e9: Waiting for close lock at 1676300634130Disabling compacts and flushes for region at 1676300634130Disabling writes for close at 1676300634130Writing region close event to WAL at 1676300634130Closed at 1676300634130 2023-02-13 15:03:54,131 INFO [RS:1;jenkins-hbase20:37973] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/WALs/jenkins-hbase20.apache.org,37973,1676300632771/jenkins-hbase20.apache.org%2C37973%2C1676300632771.1676300634104 2023-02-13 15:03:54,131 DEBUG [RS:1;jenkins-hbase20:37973] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39903,DS-b3c1dc3f-ac19-4651-81c7-48adf8f8d1a6,DISK], DatanodeInfoWithStorage[127.0.0.1:35353,DS-ca073c73-1276-437a-819c-dcef13498796,DISK]] 2023-02-13 15:03:54,133 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,133 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 43d37b28ba2ca53cc46d9a3eb2cf8f58, disabling compactions & flushes 2023-02-13 15:03:54,133 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,133 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,133 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. after waiting 0 ms 2023-02-13 15:03:54,133 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,133 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,133 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: Waiting for close lock at 1676300634133Disabling compacts and flushes for region at 1676300634133Disabling writes for close at 1676300634133Writing region close event to WAL at 1676300634133Closed at 1676300634133 2023-02-13 15:03:54,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:03:54,136 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,136 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676300634038.34f648530b1105ec25f211671a058a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300634136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300634136"}]},"ts":"1676300634136"} 2023-02-13 15:03:54,139 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 15:03:54,140 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:03:54,140 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300634140"}]},"ts":"1676300634140"} 2023-02-13 15:03:54,141 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-13 15:03:54,143 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:03:54,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:54,148 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:03:54,149 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:03:54,149 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:03:54,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b25ff1d552763fac8d24645cf323a09, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e34c258292c61e5a3f7b1f3e0ae0bdb2, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=900c7d4f37133b0b975bf94983743ed9, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=410d925effc6aa195d66785a9f0b011a, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad04c80fd3e621f78ed2f74eba56670b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34f648530b1105ec25f211671a058a0f, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=445d6c9e05b4f7c96ae0031b5ccefc4f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=65ded8d6d3cd268fe403bceb06ac67e9, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8573c998975004b464501ca9fe5d93c6, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43d37b28ba2ca53cc46d9a3eb2cf8f58, ASSIGN}] 2023-02-13 15:03:54,151 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43d37b28ba2ca53cc46d9a3eb2cf8f58, ASSIGN 2023-02-13 15:03:54,151 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8573c998975004b464501ca9fe5d93c6, ASSIGN 2023-02-13 15:03:54,151 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=65ded8d6d3cd268fe403bceb06ac67e9, ASSIGN 2023-02-13 15:03:54,152 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=445d6c9e05b4f7c96ae0031b5ccefc4f, ASSIGN 2023-02-13 15:03:54,152 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34f648530b1105ec25f211671a058a0f, ASSIGN 2023-02-13 15:03:54,152 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8573c998975004b464501ca9fe5d93c6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42649,1676300632735; forceNewPlan=false, retain=false 2023-02-13 15:03:54,152 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43d37b28ba2ca53cc46d9a3eb2cf8f58, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42649,1676300632735; forceNewPlan=false, retain=false 2023-02-13 15:03:54,152 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=445d6c9e05b4f7c96ae0031b5ccefc4f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37973,1676300632771; forceNewPlan=false, retain=false 2023-02-13 15:03:54,152 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=65ded8d6d3cd268fe403bceb06ac67e9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37973,1676300632771; forceNewPlan=false, retain=false 2023-02-13 15:03:54,153 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34f648530b1105ec25f211671a058a0f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37973,1676300632771; forceNewPlan=false, retain=false 2023-02-13 15:03:54,153 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=410d925effc6aa195d66785a9f0b011a, ASSIGN 2023-02-13 15:03:54,153 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad04c80fd3e621f78ed2f74eba56670b, ASSIGN 2023-02-13 15:03:54,153 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=900c7d4f37133b0b975bf94983743ed9, ASSIGN 2023-02-13 15:03:54,153 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e34c258292c61e5a3f7b1f3e0ae0bdb2, ASSIGN 2023-02-13 15:03:54,153 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b25ff1d552763fac8d24645cf323a09, ASSIGN 2023-02-13 15:03:54,153 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad04c80fd3e621f78ed2f74eba56670b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42649,1676300632735; forceNewPlan=false, retain=false 2023-02-13 15:03:54,153 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=410d925effc6aa195d66785a9f0b011a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42649,1676300632735; forceNewPlan=false, retain=false 2023-02-13 15:03:54,154 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=900c7d4f37133b0b975bf94983743ed9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37973,1676300632771; forceNewPlan=false, retain=false 2023-02-13 15:03:54,154 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e34c258292c61e5a3f7b1f3e0ae0bdb2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42649,1676300632735; forceNewPlan=false, retain=false 2023-02-13 15:03:54,154 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b25ff1d552763fac8d24645cf323a09, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37973,1676300632771; forceNewPlan=false, retain=false 2023-02-13 15:03:54,302 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 15:03:54,309 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ad04c80fd3e621f78ed2f74eba56670b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,309 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e34c258292c61e5a3f7b1f3e0ae0bdb2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,309 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634309"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634309"}]},"ts":"1676300634309"} 2023-02-13 15:03:54,309 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=410d925effc6aa195d66785a9f0b011a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,309 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=43d37b28ba2ca53cc46d9a3eb2cf8f58, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,309 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8573c998975004b464501ca9fe5d93c6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,309 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300634309"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634309"}]},"ts":"1676300634309"} 2023-02-13 15:03:54,309 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634309"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634309"}]},"ts":"1676300634309"} 2023-02-13 15:03:54,309 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634309"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634309"}]},"ts":"1676300634309"} 2023-02-13 15:03:54,309 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634309"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634309"}]},"ts":"1676300634309"} 2023-02-13 15:03:54,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure ad04c80fd3e621f78ed2f74eba56670b, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:54,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure 8573c998975004b464501ca9fe5d93c6, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:54,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 43d37b28ba2ca53cc46d9a3eb2cf8f58, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:54,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure e34c258292c61e5a3f7b1f3e0ae0bdb2, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:54,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 410d925effc6aa195d66785a9f0b011a, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:54,317 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3b25ff1d552763fac8d24645cf323a09, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,317 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300634317"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634317"}]},"ts":"1676300634317"} 2023-02-13 15:03:54,318 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=34f648530b1105ec25f211671a058a0f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,318 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676300634038.34f648530b1105ec25f211671a058a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634318"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634318"}]},"ts":"1676300634318"} 2023-02-13 15:03:54,318 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=65ded8d6d3cd268fe403bceb06ac67e9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,318 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634318"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634318"}]},"ts":"1676300634318"} 2023-02-13 15:03:54,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure 3b25ff1d552763fac8d24645cf323a09, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:54,319 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=900c7d4f37133b0b975bf94983743ed9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,319 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=445d6c9e05b4f7c96ae0031b5ccefc4f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,319 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634319"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634319"}]},"ts":"1676300634319"} 2023-02-13 15:03:54,319 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634319"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300634319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300634319"}]},"ts":"1676300634319"} 2023-02-13 15:03:54,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 34f648530b1105ec25f211671a058a0f, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:54,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 65ded8d6d3cd268fe403bceb06ac67e9, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:54,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 900c7d4f37133b0b975bf94983743ed9, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:54,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure 445d6c9e05b4f7c96ae0031b5ccefc4f, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:54,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:54,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8573c998975004b464501ca9fe5d93c6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 15:03:54,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,468 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,469 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1 2023-02-13 15:03:54,469 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1 2023-02-13 15:03:54,469 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8573c998975004b464501ca9fe5d93c6 columnFamilyName f1 2023-02-13 15:03:54,470 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(310): Store=8573c998975004b464501ca9fe5d93c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,470 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,471 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2 2023-02-13 15:03:54,471 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2 2023-02-13 15:03:54,471 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8573c998975004b464501ca9fe5d93c6 columnFamilyName f2 2023-02-13 15:03:54,472 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(310): Store=8573c998975004b464501ca9fe5d93c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 445d6c9e05b4f7c96ae0031b5ccefc4f, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 15:03:54,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:54,476 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,477 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1 2023-02-13 15:03:54,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8573c998975004b464501ca9fe5d93c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65931558, jitterRate=-0.01754322648048401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,477 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1 2023-02-13 15:03:54,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8573c998975004b464501ca9fe5d93c6: Running coprocessor pre-open hook at 1676300634467Writing region info on filesystem at 1676300634467Initializing all the Stores at 1676300634467Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634467Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634468 (+1 ms)Cleaning up temporary data from old regions at 1676300634473 (+5 ms)Cleaning up detritus from prior splits at 1676300634473Running coprocessor post-open hooks at 1676300634477 (+4 ms)Region opened successfully at 1676300634478 (+1 ms) 2023-02-13 15:03:54,478 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 445d6c9e05b4f7c96ae0031b5ccefc4f columnFamilyName f1 2023-02-13 15:03:54,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6., pid=22, masterSystemTime=1676300634462 2023-02-13 15:03:54,478 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(310): Store=445d6c9e05b4f7c96ae0031b5ccefc4f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,478 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 43d37b28ba2ca53cc46d9a3eb2cf8f58, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 15:03:54,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8573c998975004b464501ca9fe5d93c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634480"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634480"}]},"ts":"1676300634480"} 2023-02-13 15:03:54,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,481 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,481 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2 2023-02-13 15:03:54,481 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2 2023-02-13 15:03:54,482 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 445d6c9e05b4f7c96ae0031b5ccefc4f columnFamilyName f2 2023-02-13 15:03:54,483 DEBUG [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f1 2023-02-13 15:03:54,483 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(310): Store=445d6c9e05b4f7c96ae0031b5ccefc4f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,483 DEBUG [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f1 2023-02-13 15:03:54,483 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d37b28ba2ca53cc46d9a3eb2cf8f58 columnFamilyName f1 2023-02-13 15:03:54,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-13 15:03:54,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure 8573c998975004b464501ca9fe5d93c6, server=jenkins-hbase20.apache.org,42649,1676300632735 in 170 msec 2023-02-13 15:03:54,484 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(310): Store=43d37b28ba2ca53cc46d9a3eb2cf8f58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,484 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8573c998975004b464501ca9fe5d93c6, ASSIGN in 335 msec 2023-02-13 15:03:54,485 DEBUG [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f2 2023-02-13 15:03:54,485 DEBUG [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f2 2023-02-13 15:03:54,485 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d37b28ba2ca53cc46d9a3eb2cf8f58 columnFamilyName f2 2023-02-13 15:03:54,486 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(310): Store=43d37b28ba2ca53cc46d9a3eb2cf8f58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:54,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:54,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 445d6c9e05b4f7c96ae0031b5ccefc4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71412629, jitterRate=0.06413109600543976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: Running coprocessor pre-open hook at 1676300634474Writing region info on filesystem at 1676300634474Initializing all the Stores at 1676300634474Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634475 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634476 (+1 ms)Cleaning up temporary data from old regions at 1676300634485 (+9 ms)Cleaning up detritus from prior splits at 1676300634486 (+1 ms)Running coprocessor post-open hooks at 1676300634494 (+8 ms)Region opened successfully at 1676300634494 2023-02-13 15:03:54,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 43d37b28ba2ca53cc46d9a3eb2cf8f58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70942461, jitterRate=0.05712504684925079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: Running coprocessor pre-open hook at 1676300634480Writing region info on filesystem at 1676300634480Initializing all the Stores at 1676300634481 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634481Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634481Cleaning up temporary data from old regions at 1676300634492 (+11 ms)Cleaning up detritus from prior splits at 1676300634492Running coprocessor post-open hooks at 1676300634496 (+4 ms)Region opened successfully at 1676300634496 2023-02-13 15:03:54,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58., pid=23, masterSystemTime=1676300634462 2023-02-13 15:03:54,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 410d925effc6aa195d66785a9f0b011a, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 15:03:54,498 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=43d37b28ba2ca53cc46d9a3eb2cf8f58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,499 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300634498"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634498"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634498"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634498"}]},"ts":"1676300634498"} 2023-02-13 15:03:54,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f., pid=30, masterSystemTime=1676300634470 2023-02-13 15:03:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 900c7d4f37133b0b975bf94983743ed9, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 15:03:54,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,501 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=445d6c9e05b4f7c96ae0031b5ccefc4f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,501 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634501"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634501"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634501"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634501"}]},"ts":"1676300634501"} 2023-02-13 15:03:54,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-13 15:03:54,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 43d37b28ba2ca53cc46d9a3eb2cf8f58, server=jenkins-hbase20.apache.org,42649,1676300632735 in 189 msec 2023-02-13 15:03:54,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43d37b28ba2ca53cc46d9a3eb2cf8f58, ASSIGN in 355 msec 2023-02-13 15:03:54,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-13 15:03:54,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure 445d6c9e05b4f7c96ae0031b5ccefc4f, server=jenkins-hbase20.apache.org,37973,1676300632771 in 181 msec 2023-02-13 15:03:54,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=445d6c9e05b4f7c96ae0031b5ccefc4f, ASSIGN in 356 msec 2023-02-13 15:03:54,509 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,509 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,511 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1 2023-02-13 15:03:54,511 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1 2023-02-13 15:03:54,511 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1 2023-02-13 15:03:54,511 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1 2023-02-13 15:03:54,511 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c7d4f37133b0b975bf94983743ed9 columnFamilyName f1 2023-02-13 15:03:54,512 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 410d925effc6aa195d66785a9f0b011a columnFamilyName f1 2023-02-13 15:03:54,512 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(310): Store=900c7d4f37133b0b975bf94983743ed9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,512 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(310): Store=410d925effc6aa195d66785a9f0b011a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,512 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,512 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,513 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2 2023-02-13 15:03:54,513 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2 2023-02-13 15:03:54,513 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2 2023-02-13 15:03:54,513 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2 2023-02-13 15:03:54,514 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c7d4f37133b0b975bf94983743ed9 columnFamilyName f2 2023-02-13 15:03:54,514 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 410d925effc6aa195d66785a9f0b011a columnFamilyName f2 2023-02-13 15:03:54,514 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(310): Store=900c7d4f37133b0b975bf94983743ed9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,514 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(310): Store=410d925effc6aa195d66785a9f0b011a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:54,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:54,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 900c7d4f37133b0b975bf94983743ed9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58821487, jitterRate=-0.12349154055118561}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 900c7d4f37133b0b975bf94983743ed9: Running coprocessor pre-open hook at 1676300634501Writing region info on filesystem at 1676300634501Initializing all the Stores at 1676300634502 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634502Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634509 (+7 ms)Cleaning up temporary data from old regions at 1676300634515 (+6 ms)Cleaning up detritus from prior splits at 1676300634516 (+1 ms)Running coprocessor post-open hooks at 1676300634520 (+4 ms)Region opened successfully at 1676300634520 2023-02-13 15:03:54,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 410d925effc6aa195d66785a9f0b011a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74197731, jitterRate=0.10563234984874725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 410d925effc6aa195d66785a9f0b011a: Running coprocessor pre-open hook at 1676300634499Writing region info on filesystem at 1676300634499Initializing all the Stores at 1676300634500 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634500Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634509 (+9 ms)Cleaning up temporary data from old regions at 1676300634516 (+7 ms)Cleaning up detritus from prior splits at 1676300634516Running coprocessor post-open hooks at 1676300634520 (+4 ms)Region opened successfully at 1676300634520 2023-02-13 15:03:54,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a., pid=25, masterSystemTime=1676300634462 2023-02-13 15:03:54,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9., pid=29, masterSystemTime=1676300634470 2023-02-13 15:03:54,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e34c258292c61e5a3f7b1f3e0ae0bdb2, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 15:03:54,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,524 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=410d925effc6aa195d66785a9f0b011a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,524 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634523"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634523"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634523"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634523"}]},"ts":"1676300634523"} 2023-02-13 15:03:54,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3b25ff1d552763fac8d24645cf323a09, NAME => 'testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 15:03:54,524 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=900c7d4f37133b0b975bf94983743ed9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634525"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634525"}]},"ts":"1676300634525"} 2023-02-13 15:03:54,527 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1 2023-02-13 15:03:54,527 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1 2023-02-13 15:03:54,527 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,527 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e34c258292c61e5a3f7b1f3e0ae0bdb2 columnFamilyName f1 2023-02-13 15:03:54,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-13 15:03:54,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 410d925effc6aa195d66785a9f0b011a, server=jenkins-hbase20.apache.org,42649,1676300632735 in 213 msec 2023-02-13 15:03:54,528 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(310): Store=e34c258292c61e5a3f7b1f3e0ae0bdb2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,529 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,529 DEBUG [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f1 2023-02-13 15:03:54,529 DEBUG [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f1 2023-02-13 15:03:54,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-13 15:03:54,529 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b25ff1d552763fac8d24645cf323a09 columnFamilyName f1 2023-02-13 15:03:54,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=410d925effc6aa195d66785a9f0b011a, ASSIGN in 379 msec 2023-02-13 15:03:54,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 900c7d4f37133b0b975bf94983743ed9, server=jenkins-hbase20.apache.org,37973,1676300632771 in 207 msec 2023-02-13 15:03:54,530 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(310): Store=3b25ff1d552763fac8d24645cf323a09/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,530 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=900c7d4f37133b0b975bf94983743ed9, ASSIGN in 380 msec 2023-02-13 15:03:54,531 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2 2023-02-13 15:03:54,531 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2 2023-02-13 15:03:54,531 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e34c258292c61e5a3f7b1f3e0ae0bdb2 columnFamilyName f2 2023-02-13 15:03:54,531 DEBUG [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f2 2023-02-13 15:03:54,531 DEBUG [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f2 2023-02-13 15:03:54,532 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(310): Store=e34c258292c61e5a3f7b1f3e0ae0bdb2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,532 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b25ff1d552763fac8d24645cf323a09 columnFamilyName f2 2023-02-13 15:03:54,532 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(310): Store=3b25ff1d552763fac8d24645cf323a09/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:54,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:54,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e34c258292c61e5a3f7b1f3e0ae0bdb2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66355432, jitterRate=-0.011227011680603027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: Running coprocessor pre-open hook at 1676300634523Writing region info on filesystem at 1676300634523Initializing all the Stores at 1676300634524 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634524Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634524Cleaning up temporary data from old regions at 1676300634534 (+10 ms)Cleaning up detritus from prior splits at 1676300634534Running coprocessor post-open hooks at 1676300634538 (+4 ms)Region opened successfully at 1676300634538 2023-02-13 15:03:54,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 3b25ff1d552763fac8d24645cf323a09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73746364, jitterRate=0.09890645742416382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 3b25ff1d552763fac8d24645cf323a09: Running coprocessor pre-open hook at 1676300634526Writing region info on filesystem at 1676300634526Initializing all the Stores at 1676300634527 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634527Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634527Cleaning up temporary data from old regions at 1676300634534 (+7 ms)Cleaning up detritus from prior splits at 1676300634534Running coprocessor post-open hooks at 1676300634538 (+4 ms)Region opened successfully at 1676300634538 2023-02-13 15:03:54,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09., pid=26, masterSystemTime=1676300634470 2023-02-13 15:03:54,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2., pid=24, masterSystemTime=1676300634462 2023-02-13 15:03:54,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,541 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e34c258292c61e5a3f7b1f3e0ae0bdb2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ad04c80fd3e621f78ed2f74eba56670b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 15:03:54,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,541 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634541"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634541"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634541"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634541"}]},"ts":"1676300634541"} 2023-02-13 15:03:54,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34f648530b1105ec25f211671a058a0f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 15:03:54,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,542 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3b25ff1d552763fac8d24645cf323a09, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,543 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300634542"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634542"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634542"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634542"}]},"ts":"1676300634542"} 2023-02-13 15:03:54,544 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-13 15:03:54,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure e34c258292c61e5a3f7b1f3e0ae0bdb2, server=jenkins-hbase20.apache.org,42649,1676300632735 in 231 msec 2023-02-13 15:03:54,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-13 15:03:54,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e34c258292c61e5a3f7b1f3e0ae0bdb2, ASSIGN in 396 msec 2023-02-13 15:03:54,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure 3b25ff1d552763fac8d24645cf323a09, server=jenkins-hbase20.apache.org,37973,1676300632771 in 226 msec 2023-02-13 15:03:54,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b25ff1d552763fac8d24645cf323a09, ASSIGN in 397 msec 2023-02-13 15:03:54,548 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,549 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1 2023-02-13 15:03:54,549 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1 2023-02-13 15:03:54,549 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34f648530b1105ec25f211671a058a0f columnFamilyName f1 2023-02-13 15:03:54,549 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1 2023-02-13 15:03:54,549 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1 2023-02-13 15:03:54,549 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(310): Store=34f648530b1105ec25f211671a058a0f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,550 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,550 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad04c80fd3e621f78ed2f74eba56670b columnFamilyName f1 2023-02-13 15:03:54,550 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(310): Store=ad04c80fd3e621f78ed2f74eba56670b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,551 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2 2023-02-13 15:03:54,551 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2 2023-02-13 15:03:54,551 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,551 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34f648530b1105ec25f211671a058a0f columnFamilyName f2 2023-02-13 15:03:54,552 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(310): Store=34f648530b1105ec25f211671a058a0f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,552 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2 2023-02-13 15:03:54,552 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2 2023-02-13 15:03:54,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,552 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad04c80fd3e621f78ed2f74eba56670b columnFamilyName f2 2023-02-13 15:03:54,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,553 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(310): Store=ad04c80fd3e621f78ed2f74eba56670b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:54,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:54,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 34f648530b1105ec25f211671a058a0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58905014, jitterRate=-0.1222468912601471}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 34f648530b1105ec25f211671a058a0f: Running coprocessor pre-open hook at 1676300634542Writing region info on filesystem at 1676300634542Initializing all the Stores at 1676300634543 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634543Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634544 (+1 ms)Cleaning up temporary data from old regions at 1676300634553 (+9 ms)Cleaning up detritus from prior splits at 1676300634554 (+1 ms)Running coprocessor post-open hooks at 1676300634558 (+4 ms)Region opened successfully at 1676300634558 2023-02-13 15:03:54,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f., pid=27, masterSystemTime=1676300634470 2023-02-13 15:03:54,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened ad04c80fd3e621f78ed2f74eba56670b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64883063, jitterRate=-0.03316701948642731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for ad04c80fd3e621f78ed2f74eba56670b: Running coprocessor pre-open hook at 1676300634542Writing region info on filesystem at 1676300634542Initializing all the Stores at 1676300634543 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634544 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634548 (+4 ms)Cleaning up temporary data from old regions at 1676300634555 (+7 ms)Cleaning up detritus from prior splits at 1676300634555Running coprocessor post-open hooks at 1676300634561 (+6 ms)Region opened successfully at 1676300634561 2023-02-13 15:03:54,561 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=34f648530b1105ec25f211671a058a0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 65ded8d6d3cd268fe403bceb06ac67e9, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 15:03:54,561 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676300634038.34f648530b1105ec25f211671a058a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634561"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634561"}]},"ts":"1676300634561"} 2023-02-13 15:03:54,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:54,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b., pid=21, masterSystemTime=1676300634462 2023-02-13 15:03:54,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,563 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,564 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ad04c80fd3e621f78ed2f74eba56670b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,564 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634564"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634564"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634564"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634564"}]},"ts":"1676300634564"} 2023-02-13 15:03:54,566 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1 2023-02-13 15:03:54,566 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1 2023-02-13 15:03:54,566 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65ded8d6d3cd268fe403bceb06ac67e9 columnFamilyName f1 2023-02-13 15:03:54,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-13 15:03:54,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 34f648530b1105ec25f211671a058a0f, server=jenkins-hbase20.apache.org,37973,1676300632771 in 244 msec 2023-02-13 15:03:54,567 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(310): Store=65ded8d6d3cd268fe403bceb06ac67e9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,567 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34f648530b1105ec25f211671a058a0f, ASSIGN in 417 msec 2023-02-13 15:03:54,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-13 15:03:54,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure ad04c80fd3e621f78ed2f74eba56670b, server=jenkins-hbase20.apache.org,42649,1676300632735 in 255 msec 2023-02-13 15:03:54,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad04c80fd3e621f78ed2f74eba56670b, ASSIGN in 419 msec 2023-02-13 15:03:54,569 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2 2023-02-13 15:03:54,569 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2 2023-02-13 15:03:54,569 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65ded8d6d3cd268fe403bceb06ac67e9 columnFamilyName f2 2023-02-13 15:03:54,570 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(310): Store=65ded8d6d3cd268fe403bceb06ac67e9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:54,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:54,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:54,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:54,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 65ded8d6d3cd268fe403bceb06ac67e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70450604, jitterRate=0.04979580640792847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:54,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 65ded8d6d3cd268fe403bceb06ac67e9: Running coprocessor pre-open hook at 1676300634562Writing region info on filesystem at 1676300634562Initializing all the Stores at 1676300634563 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634563Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300634563Cleaning up temporary data from old regions at 1676300634571 (+8 ms)Cleaning up detritus from prior splits at 1676300634572 (+1 ms)Running coprocessor post-open hooks at 1676300634576 (+4 ms)Region opened successfully at 1676300634576 2023-02-13 15:03:54,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9., pid=28, masterSystemTime=1676300634470 2023-02-13 15:03:54,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=65ded8d6d3cd268fe403bceb06ac67e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,579 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300634578"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300634578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300634578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300634578"}]},"ts":"1676300634578"} 2023-02-13 15:03:54,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-13 15:03:54,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 65ded8d6d3cd268fe403bceb06ac67e9, server=jenkins-hbase20.apache.org,37973,1676300632771 in 260 msec 2023-02-13 15:03:54,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-13 15:03:54,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=65ded8d6d3cd268fe403bceb06ac67e9, ASSIGN in 432 msec 2023-02-13 15:03:54,583 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:03:54,584 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300634583"}]},"ts":"1676300634583"} 2023-02-13 15:03:54,585 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-13 15:03:54,586 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:03:54,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 549 msec 2023-02-13 15:03:54,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:03:54,649 INFO [Listener at localhost.localdomain/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-13 15:03:54,650 DEBUG [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-13 15:03:54,650 INFO [Listener at localhost.localdomain/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:54,652 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-13 15:03:54,653 INFO [Listener at localhost.localdomain/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:03:54,653 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-13 15:03:54,653 INFO [Listener at localhost.localdomain/37059] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 15:03:54,687 DEBUG [hconnection-0x76f65e73-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:54,698 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37973] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,699 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:54,705 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42649] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,776 INFO [Listener at localhost.localdomain/37059] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 15:03:54,776 INFO [Listener at localhost.localdomain/37059] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 15:03:54,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 15:03:54,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676300634777 (current time:1676300634777). 2023-02-13 15:03:54,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 15:03:54,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] zookeeper.ReadOnlyZKClient(139): Connect 0x1860d528 to 127.0.0.1:57867 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:54,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cdf9ef4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:54,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:03:54,786 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49396, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:03:54,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1860d528 to 127.0.0.1:57867 2023-02-13 15:03:54,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:54,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 15:03:54,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 15:03:54,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 15:03:54,791 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 15:03:54,791 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676301234791 2023-02-13 15:03:54,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 15:03:54,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,793 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:54,793 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 15:03:54,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 15:03:54,794 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 15:03:54,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-13 15:03:54,796 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 15:03:54,797 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676301234796 2023-02-13 15:03:54,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,807 INFO [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 15:03:54,807 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:54,808 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 15:03:54,808 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 15:03:54,809 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,809 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,810 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,810 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:54,810 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:54,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:54,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:54,810 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,810 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,810 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,810 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:54,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,811 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 15:03:54,811 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:54,811 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 15:03:54,813 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 15:03:54,813 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:03:54,813 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 15:03:54,813 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 15:03:54,813 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 15:03:54,813 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37973,1676300632771' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 15:03:54,813 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42649,1676300632735' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 15:03:54,814 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,814 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,814 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:54,814 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,814 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,815 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:54,815 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,815 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42649,1676300632735' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ba49176[Count = 1] remaining members to acquire global barrier 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:54,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:54,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37973,1676300632771' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 15:03:54,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ba49176[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:54,817 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 15:03:54,817 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,818 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,818 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,818 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:54,818 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:54,818 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,819 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:54,819 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. started... 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,819 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 15:03:54,819 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. started... 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. started... 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. started... 2023-02-13 15:03:54,819 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. started... 2023-02-13 15:03:54,823 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 15:03:54,823 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 410d925effc6aa195d66785a9f0b011a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:54,823 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 34f648530b1105ec25f211671a058a0f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:54,823 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:03:54,823 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 65ded8d6d3cd268fe403bceb06ac67e9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:54,823 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e34c258292c61e5a3f7b1f3e0ae0bdb2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 15:03:54,823 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3b25ff1d552763fac8d24645cf323a09: 2023-02-13 15:03:54,823 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,824 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. started... 2023-02-13 15:03:54,825 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,825 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ad04c80fd3e621f78ed2f74eba56670b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:54,825 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:54,825 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:54,825 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:54,855 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f1/1b2eab6e5b2440bbb261809b6d774bf9 2023-02-13 15:03:54,859 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f1/4497db45b12b421e9ddb96f1895c3982 2023-02-13 15:03:54,860 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. completed. 2023-02-13 15:03:54,860 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:54,860 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:54,860 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. started... 2023-02-13 15:03:54,860 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 15:03:54,861 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 445d6c9e05b4f7c96ae0031b5ccefc4f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:54,870 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f1/74e46b48c0d244b2af16f3267826f8d5 2023-02-13 15:03:54,876 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f1/fba17f66d79c4f8dbff2aca9fafe67c0 2023-02-13 15:03:54,881 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f1/d12434373c0744f9aaaed87138bebb93 2023-02-13 15:03:54,891 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f2/6e3706f8e75c44eea943a85c155978e4 2023-02-13 15:03:54,893 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:54,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 15:03:54,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:54,894 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 15:03:54,899 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f2/ad5a9d7e5850439a8582589c855c6e56 2023-02-13 15:03:54,906 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f1/1b2eab6e5b2440bbb261809b6d774bf9 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/1b2eab6e5b2440bbb261809b6d774bf9 2023-02-13 15:03:54,907 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f1/36cce7ee851a4b399d8e11fd7db1d736 2023-02-13 15:03:54,910 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/1b2eab6e5b2440bbb261809b6d774bf9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,911 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b 2023-02-13 15:03:54,911 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f2/6e3706f8e75c44eea943a85c155978e4 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/6e3706f8e75c44eea943a85c155978e4 2023-02-13 15:03:54,915 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f1/4497db45b12b421e9ddb96f1895c3982 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/4497db45b12b421e9ddb96f1895c3982 2023-02-13 15:03:54,916 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/6e3706f8e75c44eea943a85c155978e4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,917 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f1/74e46b48c0d244b2af16f3267826f8d5 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/74e46b48c0d244b2af16f3267826f8d5 2023-02-13 15:03:54,917 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 65ded8d6d3cd268fe403bceb06ac67e9 in 94ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:54,917 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-13 15:03:54,918 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 65ded8d6d3cd268fe403bceb06ac67e9: 2023-02-13 15:03:54,918 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,918 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:54,918 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/1b2eab6e5b2440bbb261809b6d774bf9] hfiles 2023-02-13 15:03:54,918 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/1b2eab6e5b2440bbb261809b6d774bf9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,918 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/6e3706f8e75c44eea943a85c155978e4] hfiles 2023-02-13 15:03:54,918 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/6e3706f8e75c44eea943a85c155978e4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,924 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/74e46b48c0d244b2af16f3267826f8d5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:54,924 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b 2023-02-13 15:03:54,925 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/4497db45b12b421e9ddb96f1895c3982, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,926 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f2/2514d3501142496e91ea88b71f3d1eeb 2023-02-13 15:03:54,927 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f2/f6faa2bbace54f45b7b184e316e8eaba 2023-02-13 15:03:54,927 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f2/ad5a9d7e5850439a8582589c855c6e56 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/ad5a9d7e5850439a8582589c855c6e56 2023-02-13 15:03:54,930 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:54,931 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e34c258292c61e5a3f7b1f3e0ae0bdb2 in 108ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:54,933 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: 2023-02-13 15:03:54,933 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,937 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:54,937 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/74e46b48c0d244b2af16f3267826f8d5] hfiles 2023-02-13 15:03:54,937 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/74e46b48c0d244b2af16f3267826f8d5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,937 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b] hfiles 2023-02-13 15:03:54,937 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,938 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/ad5a9d7e5850439a8582589c855c6e56, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,939 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 410d925effc6aa195d66785a9f0b011a in 116ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:54,939 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 410d925effc6aa195d66785a9f0b011a: 2023-02-13 15:03:54,939 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f1/fba17f66d79c4f8dbff2aca9fafe67c0 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/fba17f66d79c4f8dbff2aca9fafe67c0 2023-02-13 15:03:54,939 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,939 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f1/d12434373c0744f9aaaed87138bebb93 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/d12434373c0744f9aaaed87138bebb93 2023-02-13 15:03:54,940 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:54,940 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/4497db45b12b421e9ddb96f1895c3982] hfiles 2023-02-13 15:03:54,940 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/4497db45b12b421e9ddb96f1895c3982 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,940 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/ad5a9d7e5850439a8582589c855c6e56] hfiles 2023-02-13 15:03:54,940 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/ad5a9d7e5850439a8582589c855c6e56 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,957 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/d12434373c0744f9aaaed87138bebb93, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,957 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/fba17f66d79c4f8dbff2aca9fafe67c0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,958 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f2/f6faa2bbace54f45b7b184e316e8eaba as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/f6faa2bbace54f45b7b184e316e8eaba 2023-02-13 15:03:54,958 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f2/2514d3501142496e91ea88b71f3d1eeb as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2514d3501142496e91ea88b71f3d1eeb 2023-02-13 15:03:54,962 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/f6faa2bbace54f45b7b184e316e8eaba, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,962 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2514d3501142496e91ea88b71f3d1eeb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:54,963 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 34f648530b1105ec25f211671a058a0f in 140ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:54,963 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ad04c80fd3e621f78ed2f74eba56670b in 138ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 34f648530b1105ec25f211671a058a0f: 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ad04c80fd3e621f78ed2f74eba56670b: 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. completed. 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/d12434373c0744f9aaaed87138bebb93] hfiles 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/fba17f66d79c4f8dbff2aca9fafe67c0] hfiles 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/d12434373c0744f9aaaed87138bebb93 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/fba17f66d79c4f8dbff2aca9fafe67c0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,963 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/f6faa2bbace54f45b7b184e316e8eaba] hfiles 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:54,963 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2514d3501142496e91ea88b71f3d1eeb] hfiles 2023-02-13 15:03:54,964 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. started... 2023-02-13 15:03:54,964 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/f6faa2bbace54f45b7b184e316e8eaba for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,964 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2514d3501142496e91ea88b71f3d1eeb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,968 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 900c7d4f37133b0b975bf94983743ed9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 15:03:54,987 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. completed. 2023-02-13 15:03:54,987 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. completed. 2023-02-13 15:03:54,988 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:54,987 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:54,988 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 15:03:54,988 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:54,988 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 15:03:54,988 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:54,988 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. started... 2023-02-13 15:03:54,988 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. started... 2023-02-13 15:03:54,989 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: 2023-02-13 15:03:54,989 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8573c998975004b464501ca9fe5d93c6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 15:03:54,990 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:54,990 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:54,990 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:54,990 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. completed. 2023-02-13 15:03:54,990 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 15:03:54,990 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:54,991 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 15:03:55,005 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. completed. 2023-02-13 15:03:55,005 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:55,006 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 15:03:55,006 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f1/653a622bd3224928a2ec3b72458f9c85 2023-02-13 15:03:55,008 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f1/60261fd366af4b7586188d1596701975 2023-02-13 15:03:55,008 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. completed. 2023-02-13 15:03:55,008 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:55,008 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 15:03:55,033 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f2/513cfa9792664c98aedcd5b756f0456d 2023-02-13 15:03:55,038 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f1/653a622bd3224928a2ec3b72458f9c85 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/653a622bd3224928a2ec3b72458f9c85 2023-02-13 15:03:55,042 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/653a622bd3224928a2ec3b72458f9c85, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:55,043 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f2/513cfa9792664c98aedcd5b756f0456d as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/513cfa9792664c98aedcd5b756f0456d 2023-02-13 15:03:55,047 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/513cfa9792664c98aedcd5b756f0456d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:55,048 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 900c7d4f37133b0b975bf94983743ed9 in 80ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:55,048 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 900c7d4f37133b0b975bf94983743ed9: 2023-02-13 15:03:55,049 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,049 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:55,049 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/653a622bd3224928a2ec3b72458f9c85] hfiles 2023-02-13 15:03:55,049 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/653a622bd3224928a2ec3b72458f9c85 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,049 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/513cfa9792664c98aedcd5b756f0456d] hfiles 2023-02-13 15:03:55,049 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/513cfa9792664c98aedcd5b756f0456d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,055 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. completed. 2023-02-13 15:03:55,055 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:55,055 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 15:03:55,095 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:55,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 15:03:55,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:55,096 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 15:03:55,350 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f2/1c91136a351e4a38b1f8a59a317fd915 2023-02-13 15:03:55,355 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f1/36cce7ee851a4b399d8e11fd7db1d736 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/36cce7ee851a4b399d8e11fd7db1d736 2023-02-13 15:03:55,360 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/36cce7ee851a4b399d8e11fd7db1d736, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:55,361 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f2/1c91136a351e4a38b1f8a59a317fd915 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/1c91136a351e4a38b1f8a59a317fd915 2023-02-13 15:03:55,366 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/1c91136a351e4a38b1f8a59a317fd915, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 15:03:55,367 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 445d6c9e05b4f7c96ae0031b5ccefc4f in 506ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:55,367 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: 2023-02-13 15:03:55,368 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,368 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:55,368 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/36cce7ee851a4b399d8e11fd7db1d736] hfiles 2023-02-13 15:03:55,368 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/36cce7ee851a4b399d8e11fd7db1d736 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,368 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/1c91136a351e4a38b1f8a59a317fd915] hfiles 2023-02-13 15:03:55,368 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/1c91136a351e4a38b1f8a59a317fd915 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,380 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. completed. 2023-02-13 15:03:55,380 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:55,380 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 15:03:55,380 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 15:03:55,380 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,380 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 15:03:55,380 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,37973,1676300632771' in zk 2023-02-13 15:03:55,381 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 15:03:55,381 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:55,381 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 15:03:55,381 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,37973,1676300632771': 2023-02-13 15:03:55,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37973,1676300632771' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 15:03:55,396 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:55,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 15:03:55,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:03:55,398 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 15:03:55,434 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f2/cb196f103114492395955b9abebb58ae 2023-02-13 15:03:55,439 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f1/60261fd366af4b7586188d1596701975 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/60261fd366af4b7586188d1596701975 2023-02-13 15:03:55,444 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/60261fd366af4b7586188d1596701975, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:55,445 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f2/cb196f103114492395955b9abebb58ae as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/cb196f103114492395955b9abebb58ae 2023-02-13 15:03:55,449 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/cb196f103114492395955b9abebb58ae, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 15:03:55,450 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8573c998975004b464501ca9fe5d93c6 in 461ms, sequenceid=5, compaction requested=false 2023-02-13 15:03:55,450 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8573c998975004b464501ca9fe5d93c6: 2023-02-13 15:03:55,450 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,450 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:03:55,450 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/60261fd366af4b7586188d1596701975] hfiles 2023-02-13 15:03:55,450 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/60261fd366af4b7586188d1596701975 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,450 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/cb196f103114492395955b9abebb58ae] hfiles 2023-02-13 15:03:55,450 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/cb196f103114492395955b9abebb58ae for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,456 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. completed. 2023-02-13 15:03:55,456 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:55,456 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 15:03:55,456 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 15:03:55,456 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,456 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 15:03:55,456 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,42649,1676300632735' in zk 2023-02-13 15:03:55,461 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 15:03:55,461 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:55,461 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,461 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 15:03:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:55,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:55,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:55,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:55,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,42649,1676300632735': 2023-02-13 15:03:55,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42649,1676300632735' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 15:03:55,464 INFO [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 15:03:55,465 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:55,465 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:55,465 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,465 INFO [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 15:03:55,466 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:03:55,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:55,466 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:55,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:55,467 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,468 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:55,468 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:55,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:03:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:55,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:55,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:03:55,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,471 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:55,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:03:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,471 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-13 15:03:55,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,516 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:55,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676300634792Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676300635471 (+679 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676300635471Writing data manifest for testWithMockedMapReduceMultiRegion at 1676300635481 (+10 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676300635488 (+7 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676300635515 (+27 ms) 2023-02-13 15:03:55,517 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 15:03:55,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 724 msec 2023-02-13 15:03:55,898 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:03:55,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 15:03:55,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 15:03:55,900 INFO [Listener at localhost.localdomain/37059] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 15:03:55,904 INFO [Listener at localhost.localdomain/37059] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 15:03:55,910 INFO [Listener at localhost.localdomain/37059] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 15:03:55,996 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37973] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:55,997 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42649] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:56,060 INFO [Listener at localhost.localdomain/37059] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 15:03:56,065 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 15:03:56,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,068 INFO [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 15:03:56,068 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:56,069 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 15:03:56,069 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 15:03:56,070 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,070 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,071 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:56,071 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:56,071 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:56,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:56,071 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,071 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,071 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,071 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,075 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 15:03:56,075 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:56,078 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 15:03:56,078 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 15:03:56,078 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:03:56,079 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 15:03:56,079 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:56,079 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. started... 2023-02-13 15:03:56,079 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 34f648530b1105ec25f211671a058a0f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:56,079 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:56,079 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. started... 2023-02-13 15:03:56,079 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3b25ff1d552763fac8d24645cf323a09: 2023-02-13 15:03:56,080 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:56,080 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:56,080 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. started... 2023-02-13 15:03:56,080 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e34c258292c61e5a3f7b1f3e0ae0bdb2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 15:03:56,089 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 15:03:56,089 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:03:56,089 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:56,090 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. started... 2023-02-13 15:03:56,089 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:56,090 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 445d6c9e05b4f7c96ae0031b5ccefc4f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:56,090 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 15:03:56,090 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. started... 2023-02-13 15:03:56,091 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 65ded8d6d3cd268fe403bceb06ac67e9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:56,091 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 15:03:56,091 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:03:56,091 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:56,091 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:56,091 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. started... 2023-02-13 15:03:56,092 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ad04c80fd3e621f78ed2f74eba56670b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:56,091 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. started... 2023-02-13 15:03:56,093 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 410d925effc6aa195d66785a9f0b011a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:56,127 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f1/aa7358d554ba476abf5772d965405b3d 2023-02-13 15:03:56,143 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f1/062feb52c2c244f282d8fdbc0d22e08f 2023-02-13 15:03:56,157 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f1/115da61cffbe4c24b2ae65120ae92d98 2023-02-13 15:03:56,158 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f1/58f188de85724f528a57a6f5fbdbcce2 2023-02-13 15:03:56,168 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f1/6d2a2ada97de4e8eba1eba59f42fcc8a 2023-02-13 15:03:56,196 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f2/2c91985be43e4c68bd421db3006a7457 2023-02-13 15:03:56,201 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f2/21d38259b37d49a2a8922d868b5ca5a1 2023-02-13 15:03:56,201 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f2/f4568c29b84b489a9dab4be4964fb288 2023-02-13 15:03:56,203 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f1/aa7358d554ba476abf5772d965405b3d as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/aa7358d554ba476abf5772d965405b3d 2023-02-13 15:03:56,207 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f1/115da61cffbe4c24b2ae65120ae92d98 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/115da61cffbe4c24b2ae65120ae92d98 2023-02-13 15:03:56,208 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f1/062feb52c2c244f282d8fdbc0d22e08f as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/062feb52c2c244f282d8fdbc0d22e08f 2023-02-13 15:03:56,209 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/aa7358d554ba476abf5772d965405b3d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,209 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/.tmp/f2/2c91985be43e4c68bd421db3006a7457 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2c91985be43e4c68bd421db3006a7457 2023-02-13 15:03:56,216 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2c91985be43e4c68bd421db3006a7457, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,217 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 34f648530b1105ec25f211671a058a0f in 138ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,217 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 34f648530b1105ec25f211671a058a0f: 2023-02-13 15:03:56,217 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:56,217 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:56,217 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 15:03:56,217 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. started... 2023-02-13 15:03:56,217 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/115da61cffbe4c24b2ae65120ae92d98, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,217 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 900c7d4f37133b0b975bf94983743ed9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 15:03:56,220 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/062feb52c2c244f282d8fdbc0d22e08f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,221 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/.tmp/f2/f4568c29b84b489a9dab4be4964fb288 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/f4568c29b84b489a9dab4be4964fb288 2023-02-13 15:03:56,221 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f2/53f188ade40f483ca8c8a14b6cd3db52 2023-02-13 15:03:56,221 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/.tmp/f2/21d38259b37d49a2a8922d868b5ca5a1 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/21d38259b37d49a2a8922d868b5ca5a1 2023-02-13 15:03:56,226 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f2/c89764e19bc64111966f3b180ebf283b 2023-02-13 15:03:56,228 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/f4568c29b84b489a9dab4be4964fb288, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,229 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 445d6c9e05b4f7c96ae0031b5ccefc4f in 139ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,229 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: 2023-02-13 15:03:56,229 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:56,229 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 15:03:56,232 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/21d38259b37d49a2a8922d868b5ca5a1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,232 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f1/6d2a2ada97de4e8eba1eba59f42fcc8a as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/6d2a2ada97de4e8eba1eba59f42fcc8a 2023-02-13 15:03:56,233 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 410d925effc6aa195d66785a9f0b011a in 140ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 410d925effc6aa195d66785a9f0b011a: 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:56,233 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. started... 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:56,233 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. started... 2023-02-13 15:03:56,233 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 15:03:56,234 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8573c998975004b464501ca9fe5d93c6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 15:03:56,236 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f1/58f188de85724f528a57a6f5fbdbcce2 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/58f188de85724f528a57a6f5fbdbcce2 2023-02-13 15:03:56,237 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f1/63b94b72b4dd4d63b8d6eb5d0575dcb2 2023-02-13 15:03:56,238 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/6d2a2ada97de4e8eba1eba59f42fcc8a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:56,239 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/.tmp/f2/53f188ade40f483ca8c8a14b6cd3db52 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/53f188ade40f483ca8c8a14b6cd3db52 2023-02-13 15:03:56,245 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/53f188ade40f483ca8c8a14b6cd3db52, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:56,245 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e34c258292c61e5a3f7b1f3e0ae0bdb2 in 165ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,246 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: 2023-02-13 15:03:56,246 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:56,246 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 15:03:56,247 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/58f188de85724f528a57a6f5fbdbcce2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,248 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/.tmp/f2/c89764e19bc64111966f3b180ebf283b as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/c89764e19bc64111966f3b180ebf283b 2023-02-13 15:03:56,249 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f1/d7f6e37ba50b460f97e546b1318f06f7 2023-02-13 15:03:56,253 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/c89764e19bc64111966f3b180ebf283b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,255 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 65ded8d6d3cd268fe403bceb06ac67e9 in 164ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,255 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 65ded8d6d3cd268fe403bceb06ac67e9: 2023-02-13 15:03:56,255 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:56,255 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 15:03:56,257 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f2/bb7e4c7392b4495da2e28b3bf9ea5379 2023-02-13 15:03:56,261 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f1/63b94b72b4dd4d63b8d6eb5d0575dcb2 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/63b94b72b4dd4d63b8d6eb5d0575dcb2 2023-02-13 15:03:56,265 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f2/284810e81bd04341ae49f9f2cbf34f1c 2023-02-13 15:03:56,265 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/63b94b72b4dd4d63b8d6eb5d0575dcb2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,266 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/.tmp/f2/bb7e4c7392b4495da2e28b3bf9ea5379 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/bb7e4c7392b4495da2e28b3bf9ea5379 2023-02-13 15:03:56,269 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f1/d7f6e37ba50b460f97e546b1318f06f7 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/d7f6e37ba50b460f97e546b1318f06f7 2023-02-13 15:03:56,269 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/bb7e4c7392b4495da2e28b3bf9ea5379, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,270 INFO [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 900c7d4f37133b0b975bf94983743ed9 in 53ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,270 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 900c7d4f37133b0b975bf94983743ed9: 2023-02-13 15:03:56,270 DEBUG [rs(jenkins-hbase20.apache.org,37973,1676300632771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:56,270 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 15:03:56,270 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 15:03:56,270 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,271 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 15:03:56,271 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37973,1676300632771' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 15:03:56,272 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,272 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:56,272 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:56,272 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:56,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37973,1676300632771' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 15:03:56,273 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/d7f6e37ba50b460f97e546b1318f06f7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:56,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9b1eda[Count = 1] remaining members to acquire global barrier 2023-02-13 15:03:56,274 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/.tmp/f2/284810e81bd04341ae49f9f2cbf34f1c as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/284810e81bd04341ae49f9f2cbf34f1c 2023-02-13 15:03:56,279 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/284810e81bd04341ae49f9f2cbf34f1c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 15:03:56,280 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8573c998975004b464501ca9fe5d93c6 in 46ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,280 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8573c998975004b464501ca9fe5d93c6: 2023-02-13 15:03:56,280 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:56,280 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 15:03:56,570 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f1/b4167c5376a3459ba91acae126ac98c3 2023-02-13 15:03:56,583 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f2/6bc7ec2b22e94cf3af48c6ca02b20d87 2023-02-13 15:03:56,587 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f1/b4167c5376a3459ba91acae126ac98c3 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/b4167c5376a3459ba91acae126ac98c3 2023-02-13 15:03:56,591 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/b4167c5376a3459ba91acae126ac98c3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,592 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/.tmp/f2/6bc7ec2b22e94cf3af48c6ca02b20d87 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/6bc7ec2b22e94cf3af48c6ca02b20d87 2023-02-13 15:03:56,596 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/6bc7ec2b22e94cf3af48c6ca02b20d87, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 15:03:56,597 INFO [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ad04c80fd3e621f78ed2f74eba56670b in 506ms, sequenceid=9, compaction requested=false 2023-02-13 15:03:56,597 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ad04c80fd3e621f78ed2f74eba56670b: 2023-02-13 15:03:56,597 DEBUG [rs(jenkins-hbase20.apache.org,42649,1676300632735)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:56,597 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 15:03:56,597 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 15:03:56,597 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,598 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 15:03:56,598 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42649,1676300632735' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 15:03:56,599 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,599 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:56,599 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,599 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:03:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:56,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42649,1676300632735' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 15:03:56,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9b1eda[Count = 0] remaining members to acquire global barrier 2023-02-13 15:03:56,600 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 15:03:56,600 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,601 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,601 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 15:03:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 15:03:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 15:03:56,601 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,42649,1676300632735' in zk 2023-02-13 15:03:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,37973,1676300632771' in zk 2023-02-13 15:03:56,602 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,602 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:03:56,602 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,602 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 15:03:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:56,602 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:56,602 DEBUG [member: 'jenkins-hbase20.apache.org,37973,1676300632771' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 15:03:56,602 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 15:03:56,602 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,602 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:56,603 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676300632735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 15:03:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,37973,1676300632771': 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37973,1676300632771' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,42649,1676300632735': 2023-02-13 15:03:56,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42649,1676300632735' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 15:03:56,606 INFO [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 15:03:56,606 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:03:56,606 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:03:56,606 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,606 INFO [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 15:03:56,607 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,607 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,607 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:03:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:03:56,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,607 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:03:56,607 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,608 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:56,608 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,609 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:03:56,609 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:56,611 DEBUG [(jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:56,611 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-13 15:03:56,611 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:56,612 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-13 15:03:56,611 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,612 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 15:03:56,612 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,613 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:03:56,613 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:03:56,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:03:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:03:56,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:03:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:03:56,712 DEBUG [Listener at localhost.localdomain/37059] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 15:03:56,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 15:03:56,718 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676300634777 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:56,718 DEBUG [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(239): region to add: 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=34f648530b1105ec25f211671a058a0f as 34f648530b1105ec25f211671a058a0f in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=e34c258292c61e5a3f7b1f3e0ae0bdb2 as e34c258292c61e5a3f7b1f3e0ae0bdb2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=410d925effc6aa195d66785a9f0b011a as 410d925effc6aa195d66785a9f0b011a in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,719 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=ad04c80fd3e621f78ed2f74eba56670b as ad04c80fd3e621f78ed2f74eba56670b in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,720 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=3b25ff1d552763fac8d24645cf323a09 as 3b25ff1d552763fac8d24645cf323a09 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,720 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=65ded8d6d3cd268fe403bceb06ac67e9 as 65ded8d6d3cd268fe403bceb06ac67e9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,720 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=43d37b28ba2ca53cc46d9a3eb2cf8f58 as 43d37b28ba2ca53cc46d9a3eb2cf8f58 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,720 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=900c7d4f37133b0b975bf94983743ed9 as 900c7d4f37133b0b975bf94983743ed9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,720 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=445d6c9e05b4f7c96ae0031b5ccefc4f as 445d6c9e05b4f7c96ae0031b5ccefc4f in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,720 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(585): clone region=8573c998975004b464501ca9fe5d93c6 as 8573c998975004b464501ca9fe5d93c6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,721 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 43d37b28ba2ca53cc46d9a3eb2cf8f58, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,721 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 65ded8d6d3cd268fe403bceb06ac67e9, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,721 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 34f648530b1105ec25f211671a058a0f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,722 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 410d925effc6aa195d66785a9f0b011a, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,722 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e34c258292c61e5a3f7b1f3e0ae0bdb2, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,722 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => ad04c80fd3e621f78ed2f74eba56670b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,722 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 3b25ff1d552763fac8d24645cf323a09, NAME => 'testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,722 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 900c7d4f37133b0b975bf94983743ed9, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,750 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,750 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fba17f66d79c4f8dbff2aca9fafe67c0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,755 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,755 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,755 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 43d37b28ba2ca53cc46d9a3eb2cf8f58, disabling compactions & flushes 2023-02-13 15:03:56,755 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4497db45b12b421e9ddb96f1895c3982 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,755 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:56,755 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:56,755 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. after waiting 0 ms 2023-02-13 15:03:56,755 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:56,755 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:56,755 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: Waiting for close lock at 1676300636755Disabling compacts and flushes for region at 1676300636755Disabling writes for close at 1676300636755Writing region close event to WAL at 1676300636755Closed at 1676300636755 2023-02-13 15:03:56,756 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 445d6c9e05b4f7c96ae0031b5ccefc4f, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,756 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f6faa2bbace54f45b7b184e316e8eaba from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,759 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ad5a9d7e5850439a8582589c855c6e56 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,760 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing ad04c80fd3e621f78ed2f74eba56670b, disabling compactions & flushes 2023-02-13 15:03:56,760 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:56,760 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:56,760 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. after waiting 0 ms 2023-02-13 15:03:56,760 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:56,760 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:56,760 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for ad04c80fd3e621f78ed2f74eba56670b: Waiting for close lock at 1676300636760Disabling compacts and flushes for region at 1676300636760Disabling writes for close at 1676300636760Writing region close event to WAL at 1676300636760Closed at 1676300636760 2023-02-13 15:03:56,761 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 8573c998975004b464501ca9fe5d93c6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,767 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,767 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74e46b48c0d244b2af16f3267826f8d5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,769 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c301f62f4ad84bd4bb8865a7dc1b5f4b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,779 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e34c258292c61e5a3f7b1f3e0ae0bdb2, disabling compactions & flushes 2023-02-13 15:03:56,780 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:56,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:56,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. after waiting 0 ms 2023-02-13 15:03:56,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:56,780 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:56,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: Waiting for close lock at 1676300636779Disabling compacts and flushes for region at 1676300636779Disabling writes for close at 1676300636780 (+1 ms)Writing region close event to WAL at 1676300636780Closed at 1676300636780 2023-02-13 15:03:56,783 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 410d925effc6aa195d66785a9f0b011a, disabling compactions & flushes 2023-02-13 15:03:56,783 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:56,783 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:56,783 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. after waiting 0 ms 2023-02-13 15:03:56,783 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:56,783 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:56,783 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 410d925effc6aa195d66785a9f0b011a: Waiting for close lock at 1676300636783Disabling compacts and flushes for region at 1676300636783Disabling writes for close at 1676300636783Writing region close event to WAL at 1676300636783Closed at 1676300636783 2023-02-13 15:03:56,787 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,787 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,787 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d12434373c0744f9aaaed87138bebb93 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,788 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b2eab6e5b2440bbb261809b6d774bf9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,788 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,788 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 653a622bd3224928a2ec3b72458f9c85 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,792 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,792 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 3b25ff1d552763fac8d24645cf323a09, disabling compactions & flushes 2023-02-13 15:03:56,792 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 513cfa9792664c98aedcd5b756f0456d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,792 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:56,792 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:56,792 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. after waiting 0 ms 2023-02-13 15:03:56,792 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:56,792 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:56,792 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6e3706f8e75c44eea943a85c155978e4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,792 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 3b25ff1d552763fac8d24645cf323a09: Waiting for close lock at 1676300636792Disabling compacts and flushes for region at 1676300636792Disabling writes for close at 1676300636792Writing region close event to WAL at 1676300636792Closed at 1676300636792 2023-02-13 15:03:56,793 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2514d3501142496e91ea88b71f3d1eeb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,793 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,793 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 36cce7ee851a4b399d8e11fd7db1d736 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,795 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:56,795 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60261fd366af4b7586188d1596701975 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,795 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 900c7d4f37133b0b975bf94983743ed9, disabling compactions & flushes 2023-02-13 15:03:56,795 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 34f648530b1105ec25f211671a058a0f, disabling compactions & flushes 2023-02-13 15:03:56,795 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 65ded8d6d3cd268fe403bceb06ac67e9, disabling compactions & flushes 2023-02-13 15:03:56,796 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:56,795 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:56,796 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. after waiting 0 ms 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:56,796 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1c91136a351e4a38b1f8a59a317fd915 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,796 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 65ded8d6d3cd268fe403bceb06ac67e9: Waiting for close lock at 1676300636795Disabling compacts and flushes for region at 1676300636795Disabling writes for close at 1676300636796 (+1 ms)Writing region close event to WAL at 1676300636796Closed at 1676300636796 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. after waiting 0 ms 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. after waiting 0 ms 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:56,796 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 34f648530b1105ec25f211671a058a0f: Waiting for close lock at 1676300636795Disabling compacts and flushes for region at 1676300636795Disabling writes for close at 1676300636796 (+1 ms)Writing region close event to WAL at 1676300636796Closed at 1676300636796 2023-02-13 15:03:56,796 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:56,796 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:56,796 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cb196f103114492395955b9abebb58ae from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:56,797 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 900c7d4f37133b0b975bf94983743ed9: Waiting for close lock at 1676300636795Disabling compacts and flushes for region at 1676300636795Disabling writes for close at 1676300636796 (+1 ms)Writing region close event to WAL at 1676300636796Closed at 1676300636796 2023-02-13 15:03:56,797 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 445d6c9e05b4f7c96ae0031b5ccefc4f, disabling compactions & flushes 2023-02-13 15:03:56,797 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:56,797 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. after waiting 0 ms 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:56,798 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: Waiting for close lock at 1676300636797Disabling compacts and flushes for region at 1676300636797Disabling writes for close at 1676300636798 (+1 ms)Writing region close event to WAL at 1676300636798Closed at 1676300636798 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 8573c998975004b464501ca9fe5d93c6, disabling compactions & flushes 2023-02-13 15:03:56,798 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. after waiting 0 ms 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:56,798 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:56,798 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 8573c998975004b464501ca9fe5d93c6: Waiting for close lock at 1676300636798Disabling compacts and flushes for region at 1676300636798Disabling writes for close at 1676300636798Writing region close event to WAL at 1676300636798Closed at 1676300636798 2023-02-13 15:03:56,798 INFO [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676300634777 type: FLUSH version: 2 ttl: 0 2023-02-13 15:03:56,798 DEBUG [Listener at localhost.localdomain/37059] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,798 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229 2023-02-13 15:03:56,799 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-data/ 2023-02-13 15:03:56,799 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----default/ 2023-02-13 15:03:56,799 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-13 15:03:56,799 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------34f648530b1105ec25f211671a058a0f/ 2023-02-13 15:03:56,800 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,800 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,800 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=34f648530b1105ec25f211671a058a0f-d12434373c0744f9aaaed87138bebb93 2023-02-13 15:03:56,800 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,800 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=34f648530b1105ec25f211671a058a0f-2514d3501142496e91ea88b71f3d1eeb 2023-02-13 15:03:56,800 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------3b25ff1d552763fac8d24645cf323a09/ 2023-02-13 15:03:56,801 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,801 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------410d925effc6aa195d66785a9f0b011a/ 2023-02-13 15:03:56,801 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,801 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,801 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=410d925effc6aa195d66785a9f0b011a-4497db45b12b421e9ddb96f1895c3982 2023-02-13 15:03:56,801 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,802 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=410d925effc6aa195d66785a9f0b011a-ad5a9d7e5850439a8582589c855c6e56 2023-02-13 15:03:56,802 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------43d37b28ba2ca53cc46d9a3eb2cf8f58/ 2023-02-13 15:03:56,802 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,802 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------445d6c9e05b4f7c96ae0031b5ccefc4f/ 2023-02-13 15:03:56,802 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,802 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,802 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=445d6c9e05b4f7c96ae0031b5ccefc4f-36cce7ee851a4b399d8e11fd7db1d736 2023-02-13 15:03:56,803 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,803 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=445d6c9e05b4f7c96ae0031b5ccefc4f-1c91136a351e4a38b1f8a59a317fd915 2023-02-13 15:03:56,803 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------65ded8d6d3cd268fe403bceb06ac67e9/ 2023-02-13 15:03:56,803 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,803 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,804 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=65ded8d6d3cd268fe403bceb06ac67e9-1b2eab6e5b2440bbb261809b6d774bf9 2023-02-13 15:03:56,804 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,804 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=65ded8d6d3cd268fe403bceb06ac67e9-6e3706f8e75c44eea943a85c155978e4 2023-02-13 15:03:56,804 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------8573c998975004b464501ca9fe5d93c6/ 2023-02-13 15:03:56,804 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,804 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,805 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8573c998975004b464501ca9fe5d93c6-60261fd366af4b7586188d1596701975 2023-02-13 15:03:56,805 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,805 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8573c998975004b464501ca9fe5d93c6-cb196f103114492395955b9abebb58ae 2023-02-13 15:03:56,805 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------900c7d4f37133b0b975bf94983743ed9/ 2023-02-13 15:03:56,805 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,805 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,805 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=900c7d4f37133b0b975bf94983743ed9-653a622bd3224928a2ec3b72458f9c85 2023-02-13 15:03:56,806 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,806 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=900c7d4f37133b0b975bf94983743ed9-513cfa9792664c98aedcd5b756f0456d 2023-02-13 15:03:56,806 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------ad04c80fd3e621f78ed2f74eba56670b/ 2023-02-13 15:03:56,806 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,806 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,806 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ad04c80fd3e621f78ed2f74eba56670b-fba17f66d79c4f8dbff2aca9fafe67c0 2023-02-13 15:03:56,807 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,807 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ad04c80fd3e621f78ed2f74eba56670b-f6faa2bbace54f45b7b184e316e8eaba 2023-02-13 15:03:56,807 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |----------e34c258292c61e5a3f7b1f3e0ae0bdb2/ 2023-02-13 15:03:56,807 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:03:56,807 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:03:56,808 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e34c258292c61e5a3f7b1f3e0ae0bdb2-74e46b48c0d244b2af16f3267826f8d5 2023-02-13 15:03:56,808 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:03:56,808 DEBUG [Listener at localhost.localdomain/37059] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e34c258292c61e5a3f7b1f3e0ae0bdb2-c301f62f4ad84bd4bb8865a7dc1b5f4b 2023-02-13 15:03:56,811 INFO [Listener at localhost.localdomain/37059] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 15:03:57,305 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,305 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,306 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,309 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:57,310 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1 2023-02-13 15:03:57,310 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34f648530b1105ec25f211671a058a0f columnFamilyName f1 2023-02-13 15:03:57,318 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/testWithMockedMapReduceMultiRegion=34f648530b1105ec25f211671a058a0f-d12434373c0744f9aaaed87138bebb93 2023-02-13 15:03:57,318 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(310): Store=34f648530b1105ec25f211671a058a0f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,318 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:57,319 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2 2023-02-13 15:03:57,320 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34f648530b1105ec25f211671a058a0f columnFamilyName f2 2023-02-13 15:03:57,324 DEBUG [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/testWithMockedMapReduceMultiRegion=34f648530b1105ec25f211671a058a0f-2514d3501142496e91ea88b71f3d1eeb 2023-02-13 15:03:57,324 INFO [StoreOpener-34f648530b1105ec25f211671a058a0f-1] regionserver.HStore(310): Store=34f648530b1105ec25f211671a058a0f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,324 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,324 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 34f648530b1105ec25f211671a058a0f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59106046, jitterRate=-0.11925128102302551}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,324 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 34f648530b1105ec25f211671a058a0f: Writing region info on filesystem at 1676300637306Initializing all the Stores at 1676300637308 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637308Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637308Region opened successfully at 1676300637324 (+16 ms) 2023-02-13 15:03:57,332 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 34f648530b1105ec25f211671a058a0f, disabling compactions & flushes 2023-02-13 15:03:57,333 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,333 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,334 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. after waiting 0 ms 2023-02-13 15:03:57,334 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,334 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,334 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 34f648530b1105ec25f211671a058a0f: Waiting for close lock at 1676300637332Disabling compacts and flushes for region at 1676300637332Disabling writes for close at 1676300637334 (+2 ms)Writing region close event to WAL at 1676300637334Closed at 1676300637334 2023-02-13 15:03:57,335 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,335 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,336 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,338 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:57,340 DEBUG [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f1 2023-02-13 15:03:57,340 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b25ff1d552763fac8d24645cf323a09 columnFamilyName f1 2023-02-13 15:03:57,341 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(310): Store=3b25ff1d552763fac8d24645cf323a09/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,341 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:57,342 DEBUG [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f2 2023-02-13 15:03:57,342 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b25ff1d552763fac8d24645cf323a09 columnFamilyName f2 2023-02-13 15:03:57,342 INFO [StoreOpener-3b25ff1d552763fac8d24645cf323a09-1] regionserver.HStore(310): Store=3b25ff1d552763fac8d24645cf323a09/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,343 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,343 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 3b25ff1d552763fac8d24645cf323a09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60265651, jitterRate=-0.1019718199968338}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,343 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 3b25ff1d552763fac8d24645cf323a09: Writing region info on filesystem at 1676300637337Initializing all the Stores at 1676300637337Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637337Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637337Region opened successfully at 1676300637343 (+6 ms) 2023-02-13 15:03:57,343 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 3b25ff1d552763fac8d24645cf323a09, disabling compactions & flushes 2023-02-13 15:03:57,343 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,343 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,343 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. after waiting 0 ms 2023-02-13 15:03:57,343 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,344 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,344 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 3b25ff1d552763fac8d24645cf323a09: Waiting for close lock at 1676300637343Disabling compacts and flushes for region at 1676300637343Disabling writes for close at 1676300637343Writing region close event to WAL at 1676300637344 (+1 ms)Closed at 1676300637344 2023-02-13 15:03:57,344 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,344 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,345 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,347 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:57,348 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1 2023-02-13 15:03:57,348 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 410d925effc6aa195d66785a9f0b011a columnFamilyName f1 2023-02-13 15:03:57,354 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/testWithMockedMapReduceMultiRegion=410d925effc6aa195d66785a9f0b011a-4497db45b12b421e9ddb96f1895c3982 2023-02-13 15:03:57,354 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(310): Store=410d925effc6aa195d66785a9f0b011a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,355 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:57,356 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2 2023-02-13 15:03:57,356 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 410d925effc6aa195d66785a9f0b011a columnFamilyName f2 2023-02-13 15:03:57,360 DEBUG [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/testWithMockedMapReduceMultiRegion=410d925effc6aa195d66785a9f0b011a-ad5a9d7e5850439a8582589c855c6e56 2023-02-13 15:03:57,360 INFO [StoreOpener-410d925effc6aa195d66785a9f0b011a-1] regionserver.HStore(310): Store=410d925effc6aa195d66785a9f0b011a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,360 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,360 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 410d925effc6aa195d66785a9f0b011a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72361555, jitterRate=0.07827119529247284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,361 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 410d925effc6aa195d66785a9f0b011a: Writing region info on filesystem at 1676300637345Initializing all the Stores at 1676300637346 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637346Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637346Region opened successfully at 1676300637361 (+15 ms) 2023-02-13 15:03:57,368 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 410d925effc6aa195d66785a9f0b011a, disabling compactions & flushes 2023-02-13 15:03:57,369 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,369 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,369 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. after waiting 0 ms 2023-02-13 15:03:57,369 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,375 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,375 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 410d925effc6aa195d66785a9f0b011a: Waiting for close lock at 1676300637368Disabling compacts and flushes for region at 1676300637368Disabling writes for close at 1676300637369 (+1 ms)Writing region close event to WAL at 1676300637375 (+6 ms)Closed at 1676300637375 2023-02-13 15:03:57,376 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,376 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,378 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,382 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:57,383 DEBUG [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f1 2023-02-13 15:03:57,383 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d37b28ba2ca53cc46d9a3eb2cf8f58 columnFamilyName f1 2023-02-13 15:03:57,384 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(310): Store=43d37b28ba2ca53cc46d9a3eb2cf8f58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,384 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:57,385 DEBUG [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f2 2023-02-13 15:03:57,385 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d37b28ba2ca53cc46d9a3eb2cf8f58 columnFamilyName f2 2023-02-13 15:03:57,386 INFO [StoreOpener-43d37b28ba2ca53cc46d9a3eb2cf8f58-1] regionserver.HStore(310): Store=43d37b28ba2ca53cc46d9a3eb2cf8f58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,386 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,386 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 43d37b28ba2ca53cc46d9a3eb2cf8f58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75329705, jitterRate=0.12250007688999176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,386 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: Writing region info on filesystem at 1676300637378Initializing all the Stores at 1676300637379 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637379Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637380 (+1 ms)Region opened successfully at 1676300637386 (+6 ms) 2023-02-13 15:03:57,386 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 43d37b28ba2ca53cc46d9a3eb2cf8f58, disabling compactions & flushes 2023-02-13 15:03:57,387 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,387 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,387 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. after waiting 0 ms 2023-02-13 15:03:57,387 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,387 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,387 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: Waiting for close lock at 1676300637386Disabling compacts and flushes for region at 1676300637386Disabling writes for close at 1676300637387 (+1 ms)Writing region close event to WAL at 1676300637387Closed at 1676300637387 2023-02-13 15:03:57,388 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,388 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,391 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,393 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:57,394 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1 2023-02-13 15:03:57,394 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8573c998975004b464501ca9fe5d93c6 columnFamilyName f1 2023-02-13 15:03:57,398 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/testWithMockedMapReduceMultiRegion=8573c998975004b464501ca9fe5d93c6-60261fd366af4b7586188d1596701975 2023-02-13 15:03:57,399 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(310): Store=8573c998975004b464501ca9fe5d93c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,399 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:57,400 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2 2023-02-13 15:03:57,400 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8573c998975004b464501ca9fe5d93c6 columnFamilyName f2 2023-02-13 15:03:57,404 DEBUG [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/testWithMockedMapReduceMultiRegion=8573c998975004b464501ca9fe5d93c6-cb196f103114492395955b9abebb58ae 2023-02-13 15:03:57,404 INFO [StoreOpener-8573c998975004b464501ca9fe5d93c6-1] regionserver.HStore(310): Store=8573c998975004b464501ca9fe5d93c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,404 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,405 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 8573c998975004b464501ca9fe5d93c6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68250511, jitterRate=0.017011865973472595}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,405 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 8573c998975004b464501ca9fe5d93c6: Writing region info on filesystem at 1676300637391Initializing all the Stores at 1676300637392 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637392Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637392Region opened successfully at 1676300637405 (+13 ms) 2023-02-13 15:03:57,420 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 8573c998975004b464501ca9fe5d93c6, disabling compactions & flushes 2023-02-13 15:03:57,420 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,420 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,420 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. after waiting 0 ms 2023-02-13 15:03:57,420 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,423 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,423 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 8573c998975004b464501ca9fe5d93c6: Waiting for close lock at 1676300637420Disabling compacts and flushes for region at 1676300637420Disabling writes for close at 1676300637420Writing region close event to WAL at 1676300637423 (+3 ms)Closed at 1676300637423 2023-02-13 15:03:57,424 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,424 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,425 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,427 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:57,428 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1 2023-02-13 15:03:57,429 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c7d4f37133b0b975bf94983743ed9 columnFamilyName f1 2023-02-13 15:03:57,433 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/testWithMockedMapReduceMultiRegion=900c7d4f37133b0b975bf94983743ed9-653a622bd3224928a2ec3b72458f9c85 2023-02-13 15:03:57,433 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(310): Store=900c7d4f37133b0b975bf94983743ed9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,433 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:57,434 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2 2023-02-13 15:03:57,435 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c7d4f37133b0b975bf94983743ed9 columnFamilyName f2 2023-02-13 15:03:57,443 DEBUG [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/testWithMockedMapReduceMultiRegion=900c7d4f37133b0b975bf94983743ed9-513cfa9792664c98aedcd5b756f0456d 2023-02-13 15:03:57,443 INFO [StoreOpener-900c7d4f37133b0b975bf94983743ed9-1] regionserver.HStore(310): Store=900c7d4f37133b0b975bf94983743ed9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,443 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,444 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 900c7d4f37133b0b975bf94983743ed9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74755828, jitterRate=0.11394864320755005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,444 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 900c7d4f37133b0b975bf94983743ed9: Writing region info on filesystem at 1676300637425Initializing all the Stores at 1676300637426 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637426Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637426Region opened successfully at 1676300637444 (+18 ms) 2023-02-13 15:03:57,455 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 900c7d4f37133b0b975bf94983743ed9, disabling compactions & flushes 2023-02-13 15:03:57,456 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,457 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,457 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. after waiting 0 ms 2023-02-13 15:03:57,457 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,459 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,459 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 900c7d4f37133b0b975bf94983743ed9: Waiting for close lock at 1676300637455Disabling compacts and flushes for region at 1676300637455Disabling writes for close at 1676300637457 (+2 ms)Writing region close event to WAL at 1676300637459 (+2 ms)Closed at 1676300637459 2023-02-13 15:03:57,459 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,460 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,461 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,464 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:57,465 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1 2023-02-13 15:03:57,465 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65ded8d6d3cd268fe403bceb06ac67e9 columnFamilyName f1 2023-02-13 15:03:57,470 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/testWithMockedMapReduceMultiRegion=65ded8d6d3cd268fe403bceb06ac67e9-1b2eab6e5b2440bbb261809b6d774bf9 2023-02-13 15:03:57,470 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(310): Store=65ded8d6d3cd268fe403bceb06ac67e9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,470 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:57,471 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2 2023-02-13 15:03:57,472 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65ded8d6d3cd268fe403bceb06ac67e9 columnFamilyName f2 2023-02-13 15:03:57,476 DEBUG [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/testWithMockedMapReduceMultiRegion=65ded8d6d3cd268fe403bceb06ac67e9-6e3706f8e75c44eea943a85c155978e4 2023-02-13 15:03:57,477 INFO [StoreOpener-65ded8d6d3cd268fe403bceb06ac67e9-1] regionserver.HStore(310): Store=65ded8d6d3cd268fe403bceb06ac67e9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,477 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,477 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 65ded8d6d3cd268fe403bceb06ac67e9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64531646, jitterRate=-0.03840354084968567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,477 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 65ded8d6d3cd268fe403bceb06ac67e9: Writing region info on filesystem at 1676300637461Initializing all the Stores at 1676300637462 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637462Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637463 (+1 ms)Region opened successfully at 1676300637477 (+14 ms) 2023-02-13 15:03:57,490 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 65ded8d6d3cd268fe403bceb06ac67e9, disabling compactions & flushes 2023-02-13 15:03:57,491 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,491 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,491 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. after waiting 0 ms 2023-02-13 15:03:57,491 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,491 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,492 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 65ded8d6d3cd268fe403bceb06ac67e9: Waiting for close lock at 1676300637490Disabling compacts and flushes for region at 1676300637490Disabling writes for close at 1676300637491 (+1 ms)Writing region close event to WAL at 1676300637491Closed at 1676300637491 2023-02-13 15:03:57,492 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,492 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,494 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,497 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:57,498 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1 2023-02-13 15:03:57,498 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e34c258292c61e5a3f7b1f3e0ae0bdb2 columnFamilyName f1 2023-02-13 15:03:57,502 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/testWithMockedMapReduceMultiRegion=e34c258292c61e5a3f7b1f3e0ae0bdb2-74e46b48c0d244b2af16f3267826f8d5 2023-02-13 15:03:57,502 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(310): Store=e34c258292c61e5a3f7b1f3e0ae0bdb2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,502 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:57,503 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2 2023-02-13 15:03:57,504 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e34c258292c61e5a3f7b1f3e0ae0bdb2 columnFamilyName f2 2023-02-13 15:03:57,508 DEBUG [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/testWithMockedMapReduceMultiRegion=e34c258292c61e5a3f7b1f3e0ae0bdb2-c301f62f4ad84bd4bb8865a7dc1b5f4b 2023-02-13 15:03:57,508 INFO [StoreOpener-e34c258292c61e5a3f7b1f3e0ae0bdb2-1] regionserver.HStore(310): Store=e34c258292c61e5a3f7b1f3e0ae0bdb2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,508 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,508 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened e34c258292c61e5a3f7b1f3e0ae0bdb2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66692526, jitterRate=-0.0062039196491241455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,508 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: Writing region info on filesystem at 1676300637494Initializing all the Stores at 1676300637495 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637495Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637495Region opened successfully at 1676300637508 (+13 ms) 2023-02-13 15:03:57,518 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing e34c258292c61e5a3f7b1f3e0ae0bdb2, disabling compactions & flushes 2023-02-13 15:03:57,518 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,518 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,518 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. after waiting 0 ms 2023-02-13 15:03:57,518 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,523 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,523 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: Waiting for close lock at 1676300637518Disabling compacts and flushes for region at 1676300637518Disabling writes for close at 1676300637518Writing region close event to WAL at 1676300637523 (+5 ms)Closed at 1676300637523 2023-02-13 15:03:57,523 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,524 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,525 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,531 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:57,532 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1 2023-02-13 15:03:57,532 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad04c80fd3e621f78ed2f74eba56670b columnFamilyName f1 2023-02-13 15:03:57,537 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/testWithMockedMapReduceMultiRegion=ad04c80fd3e621f78ed2f74eba56670b-fba17f66d79c4f8dbff2aca9fafe67c0 2023-02-13 15:03:57,537 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(310): Store=ad04c80fd3e621f78ed2f74eba56670b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,537 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:57,538 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2 2023-02-13 15:03:57,539 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad04c80fd3e621f78ed2f74eba56670b columnFamilyName f2 2023-02-13 15:03:57,543 DEBUG [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/testWithMockedMapReduceMultiRegion=ad04c80fd3e621f78ed2f74eba56670b-f6faa2bbace54f45b7b184e316e8eaba 2023-02-13 15:03:57,543 INFO [StoreOpener-ad04c80fd3e621f78ed2f74eba56670b-1] regionserver.HStore(310): Store=ad04c80fd3e621f78ed2f74eba56670b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,543 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,544 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened ad04c80fd3e621f78ed2f74eba56670b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58722224, jitterRate=-0.12497067451477051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,544 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for ad04c80fd3e621f78ed2f74eba56670b: Writing region info on filesystem at 1676300637525Initializing all the Stores at 1676300637526 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637526Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637526Region opened successfully at 1676300637544 (+18 ms) 2023-02-13 15:03:57,561 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing ad04c80fd3e621f78ed2f74eba56670b, disabling compactions & flushes 2023-02-13 15:03:57,562 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,562 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,562 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. after waiting 0 ms 2023-02-13 15:03:57,562 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,563 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,563 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for ad04c80fd3e621f78ed2f74eba56670b: Waiting for close lock at 1676300637561Disabling compacts and flushes for region at 1676300637561Disabling writes for close at 1676300637562 (+1 ms)Writing region close event to WAL at 1676300637563 (+1 ms)Closed at 1676300637563 2023-02-13 15:03:57,563 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:57,563 INFO [Listener at localhost.localdomain/37059] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:03:57,565 DEBUG [Listener at localhost.localdomain/37059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:57,567 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:57,568 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1 2023-02-13 15:03:57,569 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 445d6c9e05b4f7c96ae0031b5ccefc4f columnFamilyName f1 2023-02-13 15:03:57,574 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/testWithMockedMapReduceMultiRegion=445d6c9e05b4f7c96ae0031b5ccefc4f-36cce7ee851a4b399d8e11fd7db1d736 2023-02-13 15:03:57,574 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(310): Store=445d6c9e05b4f7c96ae0031b5ccefc4f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,574 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:57,575 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2 2023-02-13 15:03:57,576 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 445d6c9e05b4f7c96ae0031b5ccefc4f columnFamilyName f2 2023-02-13 15:03:57,581 DEBUG [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42437/user/jenkins/test-data/10313783-13bf-2bae-4659-0e18a1c1373d/testWithMockedMapReduceMultiRegion/389af3de-057d-4098-91da-9cf750e8b229/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/testWithMockedMapReduceMultiRegion=445d6c9e05b4f7c96ae0031b5ccefc4f-1c91136a351e4a38b1f8a59a317fd915 2023-02-13 15:03:57,581 INFO [StoreOpener-445d6c9e05b4f7c96ae0031b5ccefc4f-1] regionserver.HStore(310): Store=445d6c9e05b4f7c96ae0031b5ccefc4f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:57,581 DEBUG [Listener at localhost.localdomain/37059] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:03:57,581 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1071): Opened 445d6c9e05b4f7c96ae0031b5ccefc4f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66527379, jitterRate=-0.008664801716804504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:03:57,581 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(964): Region open journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: Writing region info on filesystem at 1676300637565Initializing all the Stores at 1676300637566 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637566Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300637566Region opened successfully at 1676300637581 (+15 ms) 2023-02-13 15:03:57,594 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1603): Closing 445d6c9e05b4f7c96ae0031b5ccefc4f, disabling compactions & flushes 2023-02-13 15:03:57,594 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,594 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,594 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. after waiting 0 ms 2023-02-13 15:03:57,594 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,596 INFO [Listener at localhost.localdomain/37059] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,596 DEBUG [Listener at localhost.localdomain/37059] regionserver.HRegion(1557): Region close journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: Waiting for close lock at 1676300637594Disabling compacts and flushes for region at 1676300637594Disabling writes for close at 1676300637594Writing region close event to WAL at 1676300637596 (+2 ms)Closed at 1676300637596 2023-02-13 15:03:57,604 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-13 15:03:57,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,608 INFO [Listener at localhost.localdomain/37059] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,613 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300637612"}]},"ts":"1676300637612"} 2023-02-13 15:03:57,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 15:03:57,614 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-13 15:03:57,615 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-13 15:03:57,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b25ff1d552763fac8d24645cf323a09, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e34c258292c61e5a3f7b1f3e0ae0bdb2, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=900c7d4f37133b0b975bf94983743ed9, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=410d925effc6aa195d66785a9f0b011a, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad04c80fd3e621f78ed2f74eba56670b, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34f648530b1105ec25f211671a058a0f, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=445d6c9e05b4f7c96ae0031b5ccefc4f, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=65ded8d6d3cd268fe403bceb06ac67e9, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8573c998975004b464501ca9fe5d93c6, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43d37b28ba2ca53cc46d9a3eb2cf8f58, UNASSIGN}] 2023-02-13 15:03:57,618 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=900c7d4f37133b0b975bf94983743ed9, UNASSIGN 2023-02-13 15:03:57,618 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad04c80fd3e621f78ed2f74eba56670b, UNASSIGN 2023-02-13 15:03:57,618 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=410d925effc6aa195d66785a9f0b011a, UNASSIGN 2023-02-13 15:03:57,618 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e34c258292c61e5a3f7b1f3e0ae0bdb2, UNASSIGN 2023-02-13 15:03:57,618 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43d37b28ba2ca53cc46d9a3eb2cf8f58, UNASSIGN 2023-02-13 15:03:57,619 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e34c258292c61e5a3f7b1f3e0ae0bdb2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:57,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=900c7d4f37133b0b975bf94983743ed9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:57,619 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=410d925effc6aa195d66785a9f0b011a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:57,619 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ad04c80fd3e621f78ed2f74eba56670b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:57,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637619"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637619"}]},"ts":"1676300637619"} 2023-02-13 15:03:57,619 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637619"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637619"}]},"ts":"1676300637619"} 2023-02-13 15:03:57,619 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637619"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637619"}]},"ts":"1676300637619"} 2023-02-13 15:03:57,619 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637619"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637619"}]},"ts":"1676300637619"} 2023-02-13 15:03:57,619 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=43d37b28ba2ca53cc46d9a3eb2cf8f58, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:57,619 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300637619"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637619"}]},"ts":"1676300637619"} 2023-02-13 15:03:57,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=38, state=RUNNABLE; CloseRegionProcedure ad04c80fd3e621f78ed2f74eba56670b, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:57,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 900c7d4f37133b0b975bf94983743ed9, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:57,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 410d925effc6aa195d66785a9f0b011a, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:57,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure e34c258292c61e5a3f7b1f3e0ae0bdb2, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:57,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 43d37b28ba2ca53cc46d9a3eb2cf8f58, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:57,625 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8573c998975004b464501ca9fe5d93c6, UNASSIGN 2023-02-13 15:03:57,625 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=65ded8d6d3cd268fe403bceb06ac67e9, UNASSIGN 2023-02-13 15:03:57,626 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8573c998975004b464501ca9fe5d93c6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:57,626 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=65ded8d6d3cd268fe403bceb06ac67e9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:57,626 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=445d6c9e05b4f7c96ae0031b5ccefc4f, UNASSIGN 2023-02-13 15:03:57,626 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637626"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637626"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637626"}]},"ts":"1676300637626"} 2023-02-13 15:03:57,626 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637626"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637626"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637626"}]},"ts":"1676300637626"} 2023-02-13 15:03:57,627 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34f648530b1105ec25f211671a058a0f, UNASSIGN 2023-02-13 15:03:57,627 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=445d6c9e05b4f7c96ae0031b5ccefc4f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:57,627 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637627"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637627"}]},"ts":"1676300637627"} 2023-02-13 15:03:57,628 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=34f648530b1105ec25f211671a058a0f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:57,628 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b25ff1d552763fac8d24645cf323a09, UNASSIGN 2023-02-13 15:03:57,628 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676300634038.34f648530b1105ec25f211671a058a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637628"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637628"}]},"ts":"1676300637628"} 2023-02-13 15:03:57,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 8573c998975004b464501ca9fe5d93c6, server=jenkins-hbase20.apache.org,42649,1676300632735}] 2023-02-13 15:03:57,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 65ded8d6d3cd268fe403bceb06ac67e9, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:57,628 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3b25ff1d552763fac8d24645cf323a09, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:57,629 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300637628"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300637628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300637628"}]},"ts":"1676300637628"} 2023-02-13 15:03:57,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 445d6c9e05b4f7c96ae0031b5ccefc4f, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:57,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 34f648530b1105ec25f211671a058a0f, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:57,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 3b25ff1d552763fac8d24645cf323a09, server=jenkins-hbase20.apache.org,37973,1676300632771}] 2023-02-13 15:03:57,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 15:03:57,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:57,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:57,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 43d37b28ba2ca53cc46d9a3eb2cf8f58, disabling compactions & flushes 2023-02-13 15:03:57,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 3b25ff1d552763fac8d24645cf323a09, disabling compactions & flushes 2023-02-13 15:03:57,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. after waiting 0 ms 2023-02-13 15:03:57,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. after waiting 0 ms 2023-02-13 15:03:57,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 15:03:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 15:03:57,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09. 2023-02-13 15:03:57,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58. 2023-02-13 15:03:57,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 3b25ff1d552763fac8d24645cf323a09: Waiting for close lock at 1676300637774Running coprocessor pre-close hooks at 1676300637774Disabling compacts and flushes for region at 1676300637774Disabling writes for close at 1676300637775 (+1 ms)Writing region close event to WAL at 1676300637775Running coprocessor post-close hooks at 1676300637778 (+3 ms)Closed at 1676300637778 2023-02-13 15:03:57,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 43d37b28ba2ca53cc46d9a3eb2cf8f58: Waiting for close lock at 1676300637774Running coprocessor pre-close hooks at 1676300637774Disabling compacts and flushes for region at 1676300637774Disabling writes for close at 1676300637774Writing region close event to WAL at 1676300637775 (+1 ms)Running coprocessor post-close hooks at 1676300637778 (+3 ms)Closed at 1676300637778 2023-02-13 15:03:57,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:57,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:57,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 410d925effc6aa195d66785a9f0b011a, disabling compactions & flushes 2023-02-13 15:03:57,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. after waiting 0 ms 2023-02-13 15:03:57,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,780 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=43d37b28ba2ca53cc46d9a3eb2cf8f58, regionState=CLOSED 2023-02-13 15:03:57,780 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300637779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637779"}]},"ts":"1676300637779"} 2023-02-13 15:03:57,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:57,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:57,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 34f648530b1105ec25f211671a058a0f, disabling compactions & flushes 2023-02-13 15:03:57,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. after waiting 0 ms 2023-02-13 15:03:57,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,780 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3b25ff1d552763fac8d24645cf323a09, regionState=CLOSED 2023-02-13 15:03:57,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676300637780"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637780"}]},"ts":"1676300637780"} 2023-02-13 15:03:57,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f. 2023-02-13 15:03:57,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 34f648530b1105ec25f211671a058a0f: Waiting for close lock at 1676300637780Running coprocessor pre-close hooks at 1676300637780Disabling compacts and flushes for region at 1676300637780Disabling writes for close at 1676300637780Writing region close event to WAL at 1676300637782 (+2 ms)Running coprocessor post-close hooks at 1676300637785 (+3 ms)Closed at 1676300637785 2023-02-13 15:03:57,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:57,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:57,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 445d6c9e05b4f7c96ae0031b5ccefc4f, disabling compactions & flushes 2023-02-13 15:03:57,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. after waiting 0 ms 2023-02-13 15:03:57,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=34f648530b1105ec25f211671a058a0f, regionState=CLOSED 2023-02-13 15:03:57,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-13 15:03:57,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676300634038.34f648530b1105ec25f211671a058a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637787"}]},"ts":"1676300637787"} 2023-02-13 15:03:57,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-13 15:03:57,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 43d37b28ba2ca53cc46d9a3eb2cf8f58, server=jenkins-hbase20.apache.org,42649,1676300632735 in 159 msec 2023-02-13 15:03:57,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 3b25ff1d552763fac8d24645cf323a09, server=jenkins-hbase20.apache.org,37973,1676300632771 in 150 msec 2023-02-13 15:03:57,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b25ff1d552763fac8d24645cf323a09, UNASSIGN in 171 msec 2023-02-13 15:03:57,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43d37b28ba2ca53cc46d9a3eb2cf8f58, UNASSIGN in 171 msec 2023-02-13 15:03:57,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-13 15:03:57,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 34f648530b1105ec25f211671a058a0f, server=jenkins-hbase20.apache.org,37973,1676300632771 in 158 msec 2023-02-13 15:03:57,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34f648530b1105ec25f211671a058a0f, UNASSIGN in 173 msec 2023-02-13 15:03:57,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a. 2023-02-13 15:03:57,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 410d925effc6aa195d66785a9f0b011a: Waiting for close lock at 1676300637779Running coprocessor pre-close hooks at 1676300637779Disabling compacts and flushes for region at 1676300637779Disabling writes for close at 1676300637780 (+1 ms)Writing region close event to WAL at 1676300637781 (+1 ms)Running coprocessor post-close hooks at 1676300637795 (+14 ms)Closed at 1676300637795 2023-02-13 15:03:57,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:57,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing ad04c80fd3e621f78ed2f74eba56670b, disabling compactions & flushes 2023-02-13 15:03:57,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,797 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=410d925effc6aa195d66785a9f0b011a, regionState=CLOSED 2023-02-13 15:03:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. after waiting 0 ms 2023-02-13 15:03:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,797 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637797"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637797"}]},"ts":"1676300637797"} 2023-02-13 15:03:57,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f. 2023-02-13 15:03:57,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 445d6c9e05b4f7c96ae0031b5ccefc4f: Waiting for close lock at 1676300637787Running coprocessor pre-close hooks at 1676300637787Disabling compacts and flushes for region at 1676300637787Disabling writes for close at 1676300637787Writing region close event to WAL at 1676300637795 (+8 ms)Running coprocessor post-close hooks at 1676300637798 (+3 ms)Closed at 1676300637798 2023-02-13 15:03:57,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:57,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:57,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-13 15:03:57,800 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=445d6c9e05b4f7c96ae0031b5ccefc4f, regionState=CLOSED 2023-02-13 15:03:57,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 65ded8d6d3cd268fe403bceb06ac67e9, disabling compactions & flushes 2023-02-13 15:03:57,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 410d925effc6aa195d66785a9f0b011a, server=jenkins-hbase20.apache.org,42649,1676300632735 in 177 msec 2023-02-13 15:03:57,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,800 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637800"}]},"ts":"1676300637800"} 2023-02-13 15:03:57,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. after waiting 0 ms 2023-02-13 15:03:57,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=410d925effc6aa195d66785a9f0b011a, UNASSIGN in 184 msec 2023-02-13 15:03:57,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-13 15:03:57,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 445d6c9e05b4f7c96ae0031b5ccefc4f, server=jenkins-hbase20.apache.org,37973,1676300632771 in 172 msec 2023-02-13 15:03:57,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=445d6c9e05b4f7c96ae0031b5ccefc4f, UNASSIGN in 186 msec 2023-02-13 15:03:57,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b. 2023-02-13 15:03:57,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for ad04c80fd3e621f78ed2f74eba56670b: Waiting for close lock at 1676300637797Running coprocessor pre-close hooks at 1676300637797Disabling compacts and flushes for region at 1676300637797Disabling writes for close at 1676300637797Writing region close event to WAL at 1676300637798 (+1 ms)Running coprocessor post-close hooks at 1676300637806 (+8 ms)Closed at 1676300637806 2023-02-13 15:03:57,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:57,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:57,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e34c258292c61e5a3f7b1f3e0ae0bdb2, disabling compactions & flushes 2023-02-13 15:03:57,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. after waiting 0 ms 2023-02-13 15:03:57,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,809 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ad04c80fd3e621f78ed2f74eba56670b, regionState=CLOSED 2023-02-13 15:03:57,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637809"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637809"}]},"ts":"1676300637809"} 2023-02-13 15:03:57,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9. 2023-02-13 15:03:57,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 65ded8d6d3cd268fe403bceb06ac67e9: Waiting for close lock at 1676300637800Running coprocessor pre-close hooks at 1676300637800Disabling compacts and flushes for region at 1676300637800Disabling writes for close at 1676300637800Writing region close event to WAL at 1676300637807 (+7 ms)Running coprocessor post-close hooks at 1676300637810 (+3 ms)Closed at 1676300637810 2023-02-13 15:03:57,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:57,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:57,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 900c7d4f37133b0b975bf94983743ed9, disabling compactions & flushes 2023-02-13 15:03:57,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. after waiting 0 ms 2023-02-13 15:03:57,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2. 2023-02-13 15:03:57,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e34c258292c61e5a3f7b1f3e0ae0bdb2: Waiting for close lock at 1676300637808Running coprocessor pre-close hooks at 1676300637808Disabling compacts and flushes for region at 1676300637808Disabling writes for close at 1676300637808Writing region close event to WAL at 1676300637809 (+1 ms)Running coprocessor post-close hooks at 1676300637812 (+3 ms)Closed at 1676300637812 2023-02-13 15:03:57,813 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=65ded8d6d3cd268fe403bceb06ac67e9, regionState=CLOSED 2023-02-13 15:03:57,813 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637813"}]},"ts":"1676300637813"} 2023-02-13 15:03:57,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:57,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:57,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8573c998975004b464501ca9fe5d93c6, disabling compactions & flushes 2023-02-13 15:03:57,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=38 2023-02-13 15:03:57,815 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e34c258292c61e5a3f7b1f3e0ae0bdb2, regionState=CLOSED 2023-02-13 15:03:57,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=38, state=SUCCESS; CloseRegionProcedure ad04c80fd3e621f78ed2f74eba56670b, server=jenkins-hbase20.apache.org,42649,1676300632735 in 190 msec 2023-02-13 15:03:57,815 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637815"}]},"ts":"1676300637815"} 2023-02-13 15:03:57,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. after waiting 0 ms 2023-02-13 15:03:57,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad04c80fd3e621f78ed2f74eba56670b, UNASSIGN in 199 msec 2023-02-13 15:03:57,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-13 15:03:57,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 65ded8d6d3cd268fe403bceb06ac67e9, server=jenkins-hbase20.apache.org,37973,1676300632771 in 187 msec 2023-02-13 15:03:57,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9. 2023-02-13 15:03:57,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 900c7d4f37133b0b975bf94983743ed9: Waiting for close lock at 1676300637812Running coprocessor pre-close hooks at 1676300637812Disabling compacts and flushes for region at 1676300637812Disabling writes for close at 1676300637812Writing region close event to WAL at 1676300637813 (+1 ms)Running coprocessor post-close hooks at 1676300637818 (+5 ms)Closed at 1676300637818 2023-02-13 15:03:57,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=65ded8d6d3cd268fe403bceb06ac67e9, UNASSIGN in 201 msec 2023-02-13 15:03:57,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-13 15:03:57,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure e34c258292c61e5a3f7b1f3e0ae0bdb2, server=jenkins-hbase20.apache.org,42649,1676300632735 in 194 msec 2023-02-13 15:03:57,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:57,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e34c258292c61e5a3f7b1f3e0ae0bdb2, UNASSIGN in 203 msec 2023-02-13 15:03:57,820 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=900c7d4f37133b0b975bf94983743ed9, regionState=CLOSED 2023-02-13 15:03:57,820 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637820"}]},"ts":"1676300637820"} 2023-02-13 15:03:57,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-13 15:03:57,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 900c7d4f37133b0b975bf94983743ed9, server=jenkins-hbase20.apache.org,37973,1676300632771 in 200 msec 2023-02-13 15:03:57,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=900c7d4f37133b0b975bf94983743ed9, UNASSIGN in 206 msec 2023-02-13 15:03:57,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:03:57,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6. 2023-02-13 15:03:57,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8573c998975004b464501ca9fe5d93c6: Waiting for close lock at 1676300637815Running coprocessor pre-close hooks at 1676300637815Disabling compacts and flushes for region at 1676300637815Disabling writes for close at 1676300637815Writing region close event to WAL at 1676300637818 (+3 ms)Running coprocessor post-close hooks at 1676300637829 (+11 ms)Closed at 1676300637829 2023-02-13 15:03:57,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:57,831 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8573c998975004b464501ca9fe5d93c6, regionState=CLOSED 2023-02-13 15:03:57,831 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676300637831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300637831"}]},"ts":"1676300637831"} 2023-02-13 15:03:57,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-13 15:03:57,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 8573c998975004b464501ca9fe5d93c6, server=jenkins-hbase20.apache.org,42649,1676300632735 in 204 msec 2023-02-13 15:03:57,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-13 15:03:57,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8573c998975004b464501ca9fe5d93c6, UNASSIGN in 217 msec 2023-02-13 15:03:57,834 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300637834"}]},"ts":"1676300637834"} 2023-02-13 15:03:57,836 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-13 15:03:57,837 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-13 15:03:57,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 228 msec 2023-02-13 15:03:57,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 15:03:57,916 INFO [Listener at localhost.localdomain/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-13 15:03:57,917 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,919 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,920 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:57,929 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:57,931 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/recovered.edits] 2023-02-13 15:03:57,932 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/recovered.edits] 2023-02-13 15:03:57,932 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/recovered.edits] 2023-02-13 15:03:57,932 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/recovered.edits] 2023-02-13 15:03:57,933 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/recovered.edits] 2023-02-13 15:03:57,933 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/recovered.edits] 2023-02-13 15:03:57,933 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/recovered.edits] 2023-02-13 15:03:57,934 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/recovered.edits] 2023-02-13 15:03:57,938 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/1b2eab6e5b2440bbb261809b6d774bf9 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/1b2eab6e5b2440bbb261809b6d774bf9 2023-02-13 15:03:57,938 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/63b94b72b4dd4d63b8d6eb5d0575dcb2 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/63b94b72b4dd4d63b8d6eb5d0575dcb2 2023-02-13 15:03:57,938 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/6d2a2ada97de4e8eba1eba59f42fcc8a to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/6d2a2ada97de4e8eba1eba59f42fcc8a 2023-02-13 15:03:57,939 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/062feb52c2c244f282d8fdbc0d22e08f to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/062feb52c2c244f282d8fdbc0d22e08f 2023-02-13 15:03:57,939 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/b4167c5376a3459ba91acae126ac98c3 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/b4167c5376a3459ba91acae126ac98c3 2023-02-13 15:03:57,940 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/115da61cffbe4c24b2ae65120ae92d98 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/115da61cffbe4c24b2ae65120ae92d98 2023-02-13 15:03:57,940 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/aa7358d554ba476abf5772d965405b3d to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/aa7358d554ba476abf5772d965405b3d 2023-02-13 15:03:57,940 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/36cce7ee851a4b399d8e11fd7db1d736 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f1/36cce7ee851a4b399d8e11fd7db1d736 2023-02-13 15:03:57,941 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/58f188de85724f528a57a6f5fbdbcce2 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f1/58f188de85724f528a57a6f5fbdbcce2 2023-02-13 15:03:57,941 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/653a622bd3224928a2ec3b72458f9c85 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f1/653a622bd3224928a2ec3b72458f9c85 2023-02-13 15:03:57,941 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/recovered.edits/6.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09/recovered.edits/6.seqid 2023-02-13 15:03:57,942 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/fba17f66d79c4f8dbff2aca9fafe67c0 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f1/fba17f66d79c4f8dbff2aca9fafe67c0 2023-02-13 15:03:57,942 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/74e46b48c0d244b2af16f3267826f8d5 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f1/74e46b48c0d244b2af16f3267826f8d5 2023-02-13 15:03:57,942 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b25ff1d552763fac8d24645cf323a09 2023-02-13 15:03:57,942 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:57,942 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/4497db45b12b421e9ddb96f1895c3982 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f1/4497db45b12b421e9ddb96f1895c3982 2023-02-13 15:03:57,943 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/d12434373c0744f9aaaed87138bebb93 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f1/d12434373c0744f9aaaed87138bebb93 2023-02-13 15:03:57,945 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/6e3706f8e75c44eea943a85c155978e4 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/6e3706f8e75c44eea943a85c155978e4 2023-02-13 15:03:57,945 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/recovered.edits] 2023-02-13 15:03:57,945 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/1c91136a351e4a38b1f8a59a317fd915 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/1c91136a351e4a38b1f8a59a317fd915 2023-02-13 15:03:57,946 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/53f188ade40f483ca8c8a14b6cd3db52 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/53f188ade40f483ca8c8a14b6cd3db52 2023-02-13 15:03:57,946 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/513cfa9792664c98aedcd5b756f0456d to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/513cfa9792664c98aedcd5b756f0456d 2023-02-13 15:03:57,947 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/6bc7ec2b22e94cf3af48c6ca02b20d87 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/6bc7ec2b22e94cf3af48c6ca02b20d87 2023-02-13 15:03:57,947 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/21d38259b37d49a2a8922d868b5ca5a1 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/21d38259b37d49a2a8922d868b5ca5a1 2023-02-13 15:03:57,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2514d3501142496e91ea88b71f3d1eeb to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2514d3501142496e91ea88b71f3d1eeb 2023-02-13 15:03:57,948 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/bb7e4c7392b4495da2e28b3bf9ea5379 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/f2/bb7e4c7392b4495da2e28b3bf9ea5379 2023-02-13 15:03:57,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/c89764e19bc64111966f3b180ebf283b to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/f2/c89764e19bc64111966f3b180ebf283b 2023-02-13 15:03:57,948 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/f2/c301f62f4ad84bd4bb8865a7dc1b5f4b 2023-02-13 15:03:57,948 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/f4568c29b84b489a9dab4be4964fb288 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/f2/f4568c29b84b489a9dab4be4964fb288 2023-02-13 15:03:57,949 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/f6faa2bbace54f45b7b184e316e8eaba to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/f2/f6faa2bbace54f45b7b184e316e8eaba 2023-02-13 15:03:57,950 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2c91985be43e4c68bd421db3006a7457 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/f2/2c91985be43e4c68bd421db3006a7457 2023-02-13 15:03:57,951 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/ad5a9d7e5850439a8582589c855c6e56 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/f2/ad5a9d7e5850439a8582589c855c6e56 2023-02-13 15:03:57,954 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f/recovered.edits/12.seqid 2023-02-13 15:03:57,954 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9/recovered.edits/12.seqid 2023-02-13 15:03:57,955 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2/recovered.edits/12.seqid 2023-02-13 15:03:57,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/445d6c9e05b4f7c96ae0031b5ccefc4f 2023-02-13 15:03:57,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:57,955 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f/recovered.edits/12.seqid 2023-02-13 15:03:57,955 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/65ded8d6d3cd268fe403bceb06ac67e9 2023-02-13 15:03:57,955 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9/recovered.edits/12.seqid 2023-02-13 15:03:57,955 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/60261fd366af4b7586188d1596701975 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/60261fd366af4b7586188d1596701975 2023-02-13 15:03:57,956 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e34c258292c61e5a3f7b1f3e0ae0bdb2 2023-02-13 15:03:57,956 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/34f648530b1105ec25f211671a058a0f 2023-02-13 15:03:57,956 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/900c7d4f37133b0b975bf94983743ed9 2023-02-13 15:03:57,956 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b/recovered.edits/12.seqid 2023-02-13 15:03:57,956 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a/recovered.edits/12.seqid 2023-02-13 15:03:57,957 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad04c80fd3e621f78ed2f74eba56670b 2023-02-13 15:03:57,957 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/410d925effc6aa195d66785a9f0b011a 2023-02-13 15:03:57,957 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f1, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/f2, FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/recovered.edits] 2023-02-13 15:03:57,957 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/d7f6e37ba50b460f97e546b1318f06f7 to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f1/d7f6e37ba50b460f97e546b1318f06f7 2023-02-13 15:03:57,960 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/284810e81bd04341ae49f9f2cbf34f1c to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/284810e81bd04341ae49f9f2cbf34f1c 2023-02-13 15:03:57,961 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/cb196f103114492395955b9abebb58ae to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/f2/cb196f103114492395955b9abebb58ae 2023-02-13 15:03:57,961 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/recovered.edits/6.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58/recovered.edits/6.seqid 2023-02-13 15:03:57,962 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/43d37b28ba2ca53cc46d9a3eb2cf8f58 2023-02-13 15:03:57,963 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/recovered.edits/12.seqid to hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/archive/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6/recovered.edits/12.seqid 2023-02-13 15:03:57,964 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8573c998975004b464501ca9fe5d93c6 2023-02-13 15:03:57,964 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 15:03:57,965 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,968 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-13 15:03:57,971 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-13 15:03:57,972 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,972 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-13 15:03:57,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676300634038.34f648530b1105ec25f211671a058a0f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300637972"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,975 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 15:03:57,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3b25ff1d552763fac8d24645cf323a09, NAME => 'testWithMockedMapReduceMultiRegion,,1676300634038.3b25ff1d552763fac8d24645cf323a09.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e34c258292c61e5a3f7b1f3e0ae0bdb2, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676300634038.e34c258292c61e5a3f7b1f3e0ae0bdb2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 900c7d4f37133b0b975bf94983743ed9, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676300634038.900c7d4f37133b0b975bf94983743ed9.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 410d925effc6aa195d66785a9f0b011a, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676300634038.410d925effc6aa195d66785a9f0b011a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => ad04c80fd3e621f78ed2f74eba56670b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676300634038.ad04c80fd3e621f78ed2f74eba56670b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 34f648530b1105ec25f211671a058a0f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676300634038.34f648530b1105ec25f211671a058a0f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 445d6c9e05b4f7c96ae0031b5ccefc4f, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676300634038.445d6c9e05b4f7c96ae0031b5ccefc4f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 65ded8d6d3cd268fe403bceb06ac67e9, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676300634038.65ded8d6d3cd268fe403bceb06ac67e9.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 8573c998975004b464501ca9fe5d93c6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676300634038.8573c998975004b464501ca9fe5d93c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 43d37b28ba2ca53cc46d9a3eb2cf8f58, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676300634038.43d37b28ba2ca53cc46d9a3eb2cf8f58.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 15:03:57,975 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-13 15:03:57,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676300637975"}]},"ts":"9223372036854775807"} 2023-02-13 15:03:57,977 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-13 15:03:57,978 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 15:03:57,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 61 msec 2023-02-13 15:03:58,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 15:03:58,022 INFO [Listener at localhost.localdomain/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-13 15:03:58,022 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 15:03:58,022 INFO [Listener at localhost.localdomain/37059] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 15:03:58,022 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ab3a11d to 127.0.0.1:57867 2023-02-13 15:03:58,022 DEBUG [Listener at localhost.localdomain/37059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:58,023 DEBUG [Listener at localhost.localdomain/37059] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 15:03:58,023 DEBUG [Listener at localhost.localdomain/37059] util.JVMClusterUtil(257): Found active master hash=1481089477, stopped=false 2023-02-13 15:03:58,023 INFO [Listener at localhost.localdomain/37059] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:58,023 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:58,023 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:58,023 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:58,023 INFO [Listener at localhost.localdomain/37059] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 15:03:58,024 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:58,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:58,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:58,025 DEBUG [Listener at localhost.localdomain/37059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d8f940c to 127.0.0.1:57867 2023-02-13 15:03:58,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:58,025 DEBUG [Listener at localhost.localdomain/37059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:58,026 INFO [Listener at localhost.localdomain/37059] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42649,1676300632735' ***** 2023-02-13 15:03:58,026 INFO [Listener at localhost.localdomain/37059] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:58,026 INFO [Listener at localhost.localdomain/37059] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,37973,1676300632771' ***** 2023-02-13 15:03:58,026 INFO [Listener at localhost.localdomain/37059] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:03:58,026 INFO [RS:1;jenkins-hbase20:37973] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:58,026 INFO [RS:1;jenkins-hbase20:37973] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:58,026 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:58,026 INFO [RS:0;jenkins-hbase20:42649] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:03:58,026 INFO [RS:1;jenkins-hbase20:37973] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:58,026 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:03:58,026 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:58,026 INFO [RS:0;jenkins-hbase20:42649] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:03:58,027 INFO [RS:0;jenkins-hbase20:42649] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:03:58,027 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(3304): Received CLOSE for 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:58,027 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:58,027 DEBUG [RS:0;jenkins-hbase20:42649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x065abe0b to 127.0.0.1:57867 2023-02-13 15:03:58,026 DEBUG [RS:1;jenkins-hbase20:37973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0517bffb to 127.0.0.1:57867 2023-02-13 15:03:58,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 89013eb05de382ef59dc89f08be7dd77, disabling compactions & flushes 2023-02-13 15:03:58,028 DEBUG [RS:1;jenkins-hbase20:37973] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:58,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:58,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:58,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. after waiting 0 ms 2023-02-13 15:03:58,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:58,028 DEBUG [RS:0;jenkins-hbase20:42649] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:58,028 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:03:58,028 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1479): Online Regions={89013eb05de382ef59dc89f08be7dd77=hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77.} 2023-02-13 15:03:58,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 89013eb05de382ef59dc89f08be7dd77 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 15:03:58,028 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1505): Waiting on 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:58,028 INFO [RS:1;jenkins-hbase20:37973] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:58,028 INFO [RS:1;jenkins-hbase20:37973] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:58,028 INFO [RS:1;jenkins-hbase20:37973] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:58,028 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 15:03:58,029 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:03:58,029 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 15:03:58,029 DEBUG [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 15:03:58,030 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:03:58,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:03:58,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:03:58,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:03:58,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:03:58,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.39 KB heapSize=44.49 KB 2023-02-13 15:03:58,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.76 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/.tmp/info/478cb68711884eb7a99b292f6b9be616 2023-02-13 15:03:58,044 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 478cb68711884eb7a99b292f6b9be616 2023-02-13 15:03:58,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/.tmp/rep_barrier/1f253bfdc2a64faebed79f2de178bf07 2023-02-13 15:03:58,054 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f253bfdc2a64faebed79f2de178bf07 2023-02-13 15:03:58,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/.tmp/table/4b72671a04554e21a942efa320e8a437 2023-02-13 15:03:58,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b72671a04554e21a942efa320e8a437 2023-02-13 15:03:58,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/.tmp/info/478cb68711884eb7a99b292f6b9be616 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/info/478cb68711884eb7a99b292f6b9be616 2023-02-13 15:03:58,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 478cb68711884eb7a99b292f6b9be616 2023-02-13 15:03:58,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/info/478cb68711884eb7a99b292f6b9be616, entries=30, sequenceid=57, filesize=8.3 K 2023-02-13 15:03:58,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/.tmp/rep_barrier/1f253bfdc2a64faebed79f2de178bf07 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/rep_barrier/1f253bfdc2a64faebed79f2de178bf07 2023-02-13 15:03:58,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f253bfdc2a64faebed79f2de178bf07 2023-02-13 15:03:58,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/rep_barrier/1f253bfdc2a64faebed79f2de178bf07, entries=10, sequenceid=57, filesize=6.1 K 2023-02-13 15:03:58,074 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/.tmp/table/4b72671a04554e21a942efa320e8a437 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/table/4b72671a04554e21a942efa320e8a437 2023-02-13 15:03:58,077 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 15:03:58,077 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 15:03:58,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b72671a04554e21a942efa320e8a437 2023-02-13 15:03:58,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/table/4b72671a04554e21a942efa320e8a437, entries=13, sequenceid=57, filesize=6.1 K 2023-02-13 15:03:58,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.39 KB/29073, heapSize ~44.45 KB/45512, currentSize=0 B/0 for 1588230740 in 48ms, sequenceid=57, compaction requested=false 2023-02-13 15:03:58,082 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 15:03:58,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:03:58,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:58,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300638029Running coprocessor pre-close hooks at 1676300638029Disabling compacts and flushes for region at 1676300638029Disabling writes for close at 1676300638031 (+2 ms)Obtaining lock to block concurrent updates at 1676300638031Preparing flush snapshotting stores in 1588230740 at 1676300638031Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29073, getHeapSize=45512, getOffHeapSize=0, getCellsCount=207 at 1676300638031Flushing stores of hbase:meta,,1.1588230740 at 1676300638031Flushing 1588230740/info: creating writer at 1676300638032 (+1 ms)Flushing 1588230740/info: appending metadata at 1676300638033 (+1 ms)Flushing 1588230740/info: closing flushed file at 1676300638033Flushing 1588230740/rep_barrier: creating writer at 1676300638044 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676300638046 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676300638046Flushing 1588230740/table: creating writer at 1676300638054 (+8 ms)Flushing 1588230740/table: appending metadata at 1676300638056 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676300638056Flushing 1588230740/info: reopening flushed file at 1676300638065 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676300638070 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676300638074 (+4 ms)Finished flush of dataSize ~28.39 KB/29073, heapSize ~44.45 KB/45512, currentSize=0 B/0 for 1588230740 in 48ms, sequenceid=57, compaction requested=false at 1676300638079 (+5 ms)Writing region close event to WAL at 1676300638080 (+1 ms)Running coprocessor post-close hooks at 1676300638083 (+3 ms)Closed at 1676300638084 (+1 ms) 2023-02-13 15:03:58,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 15:03:58,093 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:58,093 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:58,117 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 15:03:58,117 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 15:03:58,229 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1505): Waiting on 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:58,231 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,37973,1676300632771; all regions closed. 2023-02-13 15:03:58,235 DEBUG [RS:1;jenkins-hbase20:37973] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/oldWALs 2023-02-13 15:03:58,235 INFO [RS:1;jenkins-hbase20:37973] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37973%2C1676300632771.meta:.meta(num 1676300633316) 2023-02-13 15:03:58,240 DEBUG [RS:1;jenkins-hbase20:37973] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/oldWALs 2023-02-13 15:03:58,240 INFO [RS:1;jenkins-hbase20:37973] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37973%2C1676300632771:(num 1676300634104) 2023-02-13 15:03:58,240 DEBUG [RS:1;jenkins-hbase20:37973] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:58,240 INFO [RS:1;jenkins-hbase20:37973] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:58,241 INFO [RS:1;jenkins-hbase20:37973] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:58,241 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:58,242 INFO [RS:1;jenkins-hbase20:37973] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37973 2023-02-13 15:03:58,242 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:58,242 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:58,242 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37973,1676300632771 2023-02-13 15:03:58,243 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:58,243 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c341321 rejected from java.util.concurrent.ThreadPoolExecutor@480b8e7f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,243 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:58,243 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@500f4e29 rejected from java.util.concurrent.ThreadPoolExecutor@480b8e7f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,243 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,37973,1676300632771] 2023-02-13 15:03:58,243 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,37973,1676300632771; numProcessing=1 2023-02-13 15:03:58,243 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,37973,1676300632771 already deleted, retry=false 2023-02-13 15:03:58,244 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,37973,1676300632771 expired; onlineServers=1 2023-02-13 15:03:58,430 DEBUG [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1505): Waiting on 89013eb05de382ef59dc89f08be7dd77 2023-02-13 15:03:58,431 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:58,431 INFO [RS:1;jenkins-hbase20:37973] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,37973,1676300632771; zookeeper connection closed. 2023-02-13 15:03:58,431 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2822fb82 rejected from java.util.concurrent.ThreadPoolExecutor@480b8e7f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,431 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:37973-0x1015c5d83e40002, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:58,431 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@477293de rejected from java.util.concurrent.ThreadPoolExecutor@480b8e7f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,431 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f76d730] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f76d730 2023-02-13 15:03:58,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/.tmp/info/62a0047a422f41dbbc1c1c7448ad909c 2023-02-13 15:03:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/.tmp/info/62a0047a422f41dbbc1c1c7448ad909c as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/info/62a0047a422f41dbbc1c1c7448ad909c 2023-02-13 15:03:58,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/info/62a0047a422f41dbbc1c1c7448ad909c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 15:03:58,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 89013eb05de382ef59dc89f08be7dd77 in 422ms, sequenceid=6, compaction requested=false 2023-02-13 15:03:58,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/data/hbase/namespace/89013eb05de382ef59dc89f08be7dd77/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 15:03:58,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:58,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 89013eb05de382ef59dc89f08be7dd77: Waiting for close lock at 1676300638027Running coprocessor pre-close hooks at 1676300638027Disabling compacts and flushes for region at 1676300638027Disabling writes for close at 1676300638028 (+1 ms)Obtaining lock to block concurrent updates at 1676300638028Preparing flush snapshotting stores in 89013eb05de382ef59dc89f08be7dd77 at 1676300638028Finished memstore snapshotting hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676300638028Flushing stores of hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. at 1676300638031 (+3 ms)Flushing 89013eb05de382ef59dc89f08be7dd77/info: creating writer at 1676300638031Flushing 89013eb05de382ef59dc89f08be7dd77/info: appending metadata at 1676300638033 (+2 ms)Flushing 89013eb05de382ef59dc89f08be7dd77/info: closing flushed file at 1676300638033Flushing 89013eb05de382ef59dc89f08be7dd77/info: reopening flushed file at 1676300638446 (+413 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 89013eb05de382ef59dc89f08be7dd77 in 422ms, sequenceid=6, compaction requested=false at 1676300638450 (+4 ms)Writing region close event to WAL at 1676300638450Running coprocessor post-close hooks at 1676300638453 (+3 ms)Closed at 1676300638453 2023-02-13 15:03:58,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676300633374.89013eb05de382ef59dc89f08be7dd77. 2023-02-13 15:03:58,630 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42649,1676300632735; all regions closed. 2023-02-13 15:03:58,634 DEBUG [RS:0;jenkins-hbase20:42649] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/oldWALs 2023-02-13 15:03:58,634 INFO [RS:0;jenkins-hbase20:42649] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42649%2C1676300632735:(num 1676300633746) 2023-02-13 15:03:58,634 DEBUG [RS:0;jenkins-hbase20:42649] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:58,634 INFO [RS:0;jenkins-hbase20:42649] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:03:58,634 INFO [RS:0;jenkins-hbase20:42649] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:03:58,634 INFO [RS:0;jenkins-hbase20:42649] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:03:58,634 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:58,634 INFO [RS:0;jenkins-hbase20:42649] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:03:58,634 INFO [RS:0;jenkins-hbase20:42649] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:03:58,635 INFO [RS:0;jenkins-hbase20:42649] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42649 2023-02-13 15:03:58,636 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:03:58,636 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42649,1676300632735 2023-02-13 15:03:58,636 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d45e20a rejected from java.util.concurrent.ThreadPoolExecutor@397a617a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,636 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42649,1676300632735] 2023-02-13 15:03:58,636 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42649,1676300632735; numProcessing=2 2023-02-13 15:03:58,637 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42649,1676300632735 already deleted, retry=false 2023-02-13 15:03:58,637 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42649,1676300632735 expired; onlineServers=0 2023-02-13 15:03:58,637 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33599,1676300632658' ***** 2023-02-13 15:03:58,637 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 15:03:58,638 DEBUG [M:0;jenkins-hbase20:33599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c782e15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:03:58,638 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33599,1676300632658 2023-02-13 15:03:58,638 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33599,1676300632658; all regions closed. 2023-02-13 15:03:58,638 DEBUG [M:0;jenkins-hbase20:33599] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:03:58,638 DEBUG [M:0;jenkins-hbase20:33599] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 15:03:58,638 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 15:03:58,638 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300632959] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300632959,5,FailOnTimeoutGroup] 2023-02-13 15:03:58,638 DEBUG [M:0;jenkins-hbase20:33599] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 15:03:58,638 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300632960] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300632960,5,FailOnTimeoutGroup] 2023-02-13 15:03:58,639 INFO [M:0;jenkins-hbase20:33599] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 15:03:58,639 INFO [M:0;jenkins-hbase20:33599] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 15:03:58,639 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:58,640 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:58,640 INFO [M:0;jenkins-hbase20:33599] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 15:03:58,640 DEBUG [M:0;jenkins-hbase20:33599] master.HMaster(1502): Stopping service threads 2023-02-13 15:03:58,640 INFO [M:0;jenkins-hbase20:33599] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 15:03:58,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:58,640 ERROR [M:0;jenkins-hbase20:33599] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 15:03:58,640 INFO [M:0;jenkins-hbase20:33599] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 15:03:58,641 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 15:03:58,641 DEBUG [M:0;jenkins-hbase20:33599] zookeeper.ZKUtil(398): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 15:03:58,641 WARN [M:0;jenkins-hbase20:33599] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 15:03:58,641 INFO [M:0;jenkins-hbase20:33599] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 15:03:58,641 INFO [M:0;jenkins-hbase20:33599] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 15:03:58,641 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:58,641 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:58,642 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:58,642 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:58,642 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:58,642 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.42 KB heapSize=200.37 KB 2023-02-13 15:03:58,650 INFO [M:0;jenkins-hbase20:33599] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.42 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a2e87f5de83c421e97378b86582f0f40 2023-02-13 15:03:58,653 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a2e87f5de83c421e97378b86582f0f40 as hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a2e87f5de83c421e97378b86582f0f40 2023-02-13 15:03:58,656 INFO [M:0;jenkins-hbase20:33599] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42437/user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a2e87f5de83c421e97378b86582f0f40, entries=53, sequenceid=357, filesize=10.7 K 2023-02-13 15:03:58,657 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(2947): Finished flush of dataSize ~167.42 KB/171435, heapSize ~200.35 KB/205160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false 2023-02-13 15:03:58,657 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:58,657 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300638641Disabling compacts and flushes for region at 1676300638641Disabling writes for close at 1676300638642 (+1 ms)Obtaining lock to block concurrent updates at 1676300638642Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676300638642Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171435, getHeapSize=205160, getOffHeapSize=0, getCellsCount=442 at 1676300638642Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676300638643 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676300638643Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676300638645 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676300638646 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676300638654 (+8 ms)Finished flush of dataSize ~167.42 KB/171435, heapSize ~200.35 KB/205160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false at 1676300638657 (+3 ms)Writing region close event to WAL at 1676300638657Closed at 1676300638657 2023-02-13 15:03:58,659 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0abc69d5-adeb-5ef2-5f29-9285c8d29a0a/MasterData/WALs/jenkins-hbase20.apache.org,33599,1676300632658/jenkins-hbase20.apache.org%2C33599%2C1676300632658.1676300632875 not finished, retry = 0 2023-02-13 15:03:58,737 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:58,737 INFO [RS:0;jenkins-hbase20:42649] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42649,1676300632735; zookeeper connection closed. 2023-02-13 15:03:58,737 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f096fee rejected from java.util.concurrent.ThreadPoolExecutor@397a617a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,737 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1015c5d83e40001, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:58,737 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27d54ad5 rejected from java.util.concurrent.ThreadPoolExecutor@397a617a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,737 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@65658bd2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@65658bd2 2023-02-13 15:03:58,738 INFO [Listener at localhost.localdomain/37059] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 15:03:58,760 INFO [M:0;jenkins-hbase20:33599] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 15:03:58,760 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:03:58,761 INFO [M:0;jenkins-hbase20:33599] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33599 2023-02-13 15:03:58,763 DEBUG [M:0;jenkins-hbase20:33599] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,33599,1676300632658 already deleted, retry=false 2023-02-13 15:03:58,835 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 15:03:58,864 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:58,864 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33599,1676300632658; zookeeper connection closed. 2023-02-13 15:03:58,864 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3a5fbbb rejected from java.util.concurrent.ThreadPoolExecutor@79a6f17[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,864 DEBUG [Listener at localhost.localdomain/37059-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1015c5d83e40000, quorum=127.0.0.1:57867, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:03:58,864 ERROR [Listener at localhost.localdomain/37059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fc49488 rejected from java.util.concurrent.ThreadPoolExecutor@79a6f17[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:03:58,865 WARN [Listener at localhost.localdomain/37059] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:58,871 INFO [Listener at localhost.localdomain/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:58,977 WARN [BP-1495343003-148.251.75.209-1676300632157 heartbeating to localhost.localdomain/127.0.0.1:42437] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:58,979 WARN [BP-1495343003-148.251.75.209-1676300632157 heartbeating to localhost.localdomain/127.0.0.1:42437] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1495343003-148.251.75.209-1676300632157 (Datanode Uuid 5f967cc4-9d90-4bab-86c2-4a3a2a7cb404) service to localhost.localdomain/127.0.0.1:42437 2023-02-13 15:03:58,979 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041/dfs/data/data3/current/BP-1495343003-148.251.75.209-1676300632157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:58,979 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041/dfs/data/data4/current/BP-1495343003-148.251.75.209-1676300632157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:58,981 WARN [Listener at localhost.localdomain/37059] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:03:58,983 INFO [Listener at localhost.localdomain/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:03:59,090 WARN [BP-1495343003-148.251.75.209-1676300632157 heartbeating to localhost.localdomain/127.0.0.1:42437] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:03:59,092 WARN [BP-1495343003-148.251.75.209-1676300632157 heartbeating to localhost.localdomain/127.0.0.1:42437] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1495343003-148.251.75.209-1676300632157 (Datanode Uuid 1885fc34-9b48-4552-bfeb-e63b46d5e674) service to localhost.localdomain/127.0.0.1:42437 2023-02-13 15:03:59,092 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041/dfs/data/data1/current/BP-1495343003-148.251.75.209-1676300632157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:59,092 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/cluster_17d5052b-9d6f-55cb-1f0e-9c1c05d16041/dfs/data/data2/current/BP-1495343003-148.251.75.209-1676300632157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:03:59,101 INFO [Listener at localhost.localdomain/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 15:03:59,216 INFO [Listener at localhost.localdomain/37059] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 15:03:59,250 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 15:03:59,263 INFO [Listener at localhost.localdomain/37059] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost.localdomain:42437 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost.localdomain:42437 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:42437 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:42437 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:42437 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:42437 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,33599,1676300632658)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:42437 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/37059.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=641 (was 570) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=6958 (was 7030) 2023-02-13 15:03:59,271 INFO [Listener at localhost.localdomain/37059] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=164, AvailableMemoryMB=6958 2023-02-13 15:03:59,279 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/hadoop.log.dir so I do NOT create it in target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec 2023-02-13 15:03:59,280 WARN [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/hadoop.tmp.dir so I do NOT create it in target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec 2023-02-13 15:03:59,280 WARN [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/417d4f5f-155d-a9c7-2039-98e43f910719/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 15:03:59,280 DEBUG [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f, deleteOnExit=true 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/test.cache.data in system properties and HBase conf 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/hadoop.log.dir in system properties and HBase conf 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 15:03:59,280 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 15:03:59,281 DEBUG [Listener at localhost.localdomain/37059] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 15:03:59,281 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/nfs.dump.dir in system properties and HBase conf 2023-02-13 15:03:59,282 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/java.io.tmpdir in system properties and HBase conf 2023-02-13 15:03:59,282 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:03:59,282 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 15:03:59,282 INFO [Listener at localhost.localdomain/37059] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 15:03:59,284 WARN [Listener at localhost.localdomain/37059] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:59,284 WARN [Listener at localhost.localdomain/37059] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:59,306 WARN [Listener at localhost.localdomain/37059] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:59,308 INFO [Listener at localhost.localdomain/37059] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:59,313 INFO [Listener at localhost.localdomain/37059] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/java.io.tmpdir/Jetty_localhost_localdomain_40011_hdfs____d0ibla/webapp 2023-02-13 15:03:59,385 INFO [Listener at localhost.localdomain/37059] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:40011 2023-02-13 15:03:59,387 WARN [Listener at localhost.localdomain/37059] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:03:59,388 WARN [Listener at localhost.localdomain/37059] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:03:59,410 WARN [Listener at localhost.localdomain/46331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:59,425 WARN [Listener at localhost.localdomain/46331] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:59,429 WARN [Listener at localhost.localdomain/46331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:59,430 INFO [Listener at localhost.localdomain/46331] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:59,434 INFO [Listener at localhost.localdomain/46331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/java.io.tmpdir/Jetty_localhost_33605_datanode____jq8ede/webapp 2023-02-13 15:03:59,507 INFO [Listener at localhost.localdomain/46331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33605 2023-02-13 15:03:59,514 WARN [Listener at localhost.localdomain/45071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:59,537 WARN [Listener at localhost.localdomain/45071] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:03:59,539 WARN [Listener at localhost.localdomain/45071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:03:59,540 INFO [Listener at localhost.localdomain/45071] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:03:59,546 INFO [Listener at localhost.localdomain/45071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/java.io.tmpdir/Jetty_localhost_35685_datanode____6zgepk/webapp 2023-02-13 15:03:59,609 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77d047aa40bfa954: Processing first storage report for DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf from datanode 6c6992d7-ad4f-47d2-85f1-e432849e80c7 2023-02-13 15:03:59,609 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77d047aa40bfa954: from storage DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf node DatanodeRegistration(127.0.0.1:44705, datanodeUuid=6c6992d7-ad4f-47d2-85f1-e432849e80c7, infoPort=41335, infoSecurePort=0, ipcPort=45071, storageInfo=lv=-57;cid=testClusterID;nsid=2111240190;c=1676300639285), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:59,609 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77d047aa40bfa954: Processing first storage report for DS-8231a398-6faa-48ce-b6e5-73498b341605 from datanode 6c6992d7-ad4f-47d2-85f1-e432849e80c7 2023-02-13 15:03:59,609 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77d047aa40bfa954: from storage DS-8231a398-6faa-48ce-b6e5-73498b341605 node DatanodeRegistration(127.0.0.1:44705, datanodeUuid=6c6992d7-ad4f-47d2-85f1-e432849e80c7, infoPort=41335, infoSecurePort=0, ipcPort=45071, storageInfo=lv=-57;cid=testClusterID;nsid=2111240190;c=1676300639285), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:59,636 INFO [Listener at localhost.localdomain/45071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35685 2023-02-13 15:03:59,643 WARN [Listener at localhost.localdomain/35289] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:03:59,709 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x619d630aa9be0ff4: Processing first storage report for DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89 from datanode d2b11005-e09f-416e-8104-d1627b523cc1 2023-02-13 15:03:59,709 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x619d630aa9be0ff4: from storage DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89 node DatanodeRegistration(127.0.0.1:40719, datanodeUuid=d2b11005-e09f-416e-8104-d1627b523cc1, infoPort=46433, infoSecurePort=0, ipcPort=35289, storageInfo=lv=-57;cid=testClusterID;nsid=2111240190;c=1676300639285), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:59,709 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x619d630aa9be0ff4: Processing first storage report for DS-763f1d26-8c7c-4ccb-a73f-77b8fbf36c91 from datanode d2b11005-e09f-416e-8104-d1627b523cc1 2023-02-13 15:03:59,709 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x619d630aa9be0ff4: from storage DS-763f1d26-8c7c-4ccb-a73f-77b8fbf36c91 node DatanodeRegistration(127.0.0.1:40719, datanodeUuid=d2b11005-e09f-416e-8104-d1627b523cc1, infoPort=46433, infoSecurePort=0, ipcPort=35289, storageInfo=lv=-57;cid=testClusterID;nsid=2111240190;c=1676300639285), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:03:59,756 DEBUG [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec 2023-02-13 15:03:59,759 INFO [Listener at localhost.localdomain/35289] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f/zookeeper_0, clientPort=50569, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 15:03:59,760 INFO [Listener at localhost.localdomain/35289] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50569 2023-02-13 15:03:59,760 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,761 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,775 INFO [Listener at localhost.localdomain/35289] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e with version=8 2023-02-13 15:03:59,776 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,776 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,777 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/hbase-staging 2023-02-13 15:03:59,778 INFO [Listener at localhost.localdomain/35289] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:59,778 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,778 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,779 INFO [Listener at localhost.localdomain/35289] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:59,779 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,779 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:59,779 INFO [Listener at localhost.localdomain/35289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:59,779 INFO [Listener at localhost.localdomain/35289] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39335 2023-02-13 15:03:59,780 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,780 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,781 INFO [Listener at localhost.localdomain/35289] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39335 connecting to ZooKeeper ensemble=127.0.0.1:50569 2023-02-13 15:03:59,787 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:393350x0, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:59,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39335-0x1015c5d9fbd0000 connected 2023-02-13 15:03:59,798 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:59,799 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:59,799 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:59,803 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39335 2023-02-13 15:03:59,803 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39335 2023-02-13 15:03:59,805 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39335 2023-02-13 15:03:59,805 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39335 2023-02-13 15:03:59,806 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39335 2023-02-13 15:03:59,806 INFO [Listener at localhost.localdomain/35289] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e, hbase.cluster.distributed=false 2023-02-13 15:03:59,815 INFO [Listener at localhost.localdomain/35289] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:59,815 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,815 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,815 INFO [Listener at localhost.localdomain/35289] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:59,816 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,816 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:59,816 INFO [Listener at localhost.localdomain/35289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:59,816 INFO [Listener at localhost.localdomain/35289] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38669 2023-02-13 15:03:59,817 INFO [Listener at localhost.localdomain/35289] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:59,819 DEBUG [Listener at localhost.localdomain/35289] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:59,819 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,820 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,820 INFO [Listener at localhost.localdomain/35289] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38669 connecting to ZooKeeper ensemble=127.0.0.1:50569 2023-02-13 15:03:59,832 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:386690x0, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:59,834 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): regionserver:386690x0, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:59,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38669-0x1015c5d9fbd0001 connected 2023-02-13 15:03:59,835 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:59,836 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:59,837 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38669 2023-02-13 15:03:59,837 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38669 2023-02-13 15:03:59,839 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38669 2023-02-13 15:03:59,839 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38669 2023-02-13 15:03:59,839 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38669 2023-02-13 15:03:59,848 INFO [Listener at localhost.localdomain/35289] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:03:59,848 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,848 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,848 INFO [Listener at localhost.localdomain/35289] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:03:59,848 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:03:59,848 INFO [Listener at localhost.localdomain/35289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:03:59,848 INFO [Listener at localhost.localdomain/35289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:03:59,849 INFO [Listener at localhost.localdomain/35289] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44817 2023-02-13 15:03:59,849 INFO [Listener at localhost.localdomain/35289] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:03:59,849 DEBUG [Listener at localhost.localdomain/35289] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:03:59,850 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,850 INFO [Listener at localhost.localdomain/35289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,851 INFO [Listener at localhost.localdomain/35289] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44817 connecting to ZooKeeper ensemble=127.0.0.1:50569 2023-02-13 15:03:59,854 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:448170x0, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:03:59,856 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): regionserver:448170x0, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:03:59,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44817-0x1015c5d9fbd0002 connected 2023-02-13 15:03:59,856 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:03:59,857 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ZKUtil(164): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:03:59,858 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44817 2023-02-13 15:03:59,859 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44817 2023-02-13 15:03:59,863 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44817 2023-02-13 15:03:59,863 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44817 2023-02-13 15:03:59,863 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44817 2023-02-13 15:03:59,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:03:59,869 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:59,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:03:59,870 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:59,870 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:59,871 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:59,871 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:03:59,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:59,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:03:59,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,39335,1676300639778 from backup master directory 2023-02-13 15:03:59,874 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:03:59,874 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:03:59,874 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:03:59,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:03:59,886 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/hbase.id with ID: 0edeaa0e-16cb-4855-97a9-59cb95712372 2023-02-13 15:03:59,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:03:59,894 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:59,905 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x524785f9 to 127.0.0.1:50569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:03:59,909 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bfb654, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:03:59,909 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:59,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 15:03:59,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:03:59,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store-tmp 2023-02-13 15:03:59,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:59,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:03:59,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:59,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:59,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:03:59,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:59,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:03:59,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300639918Disabling compacts and flushes for region at 1676300639918Disabling writes for close at 1676300639918Writing region close event to WAL at 1676300639918Closed at 1676300639918 2023-02-13 15:03:59,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/WALs/jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:03:59,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39335%2C1676300639778, suffix=, logDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/WALs/jenkins-hbase20.apache.org,39335,1676300639778, archiveDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/oldWALs, maxLogs=10 2023-02-13 15:03:59,932 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK] 2023-02-13 15:03:59,932 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK] 2023-02-13 15:03:59,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/WALs/jenkins-hbase20.apache.org,39335,1676300639778/jenkins-hbase20.apache.org%2C39335%2C1676300639778.1676300639921 2023-02-13 15:03:59,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK], DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK]] 2023-02-13 15:03:59,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:03:59,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:03:59,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:59,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:59,937 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:59,938 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 15:03:59,938 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 15:03:59,938 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:03:59,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:59,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:59,941 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:03:59,943 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:03:59,943 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62746851, jitterRate=-0.064999058842659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:03:59,943 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676300639934Initializing all the Stores at 1676300639935 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300639935Cleaning up temporary data from old regions at 1676300639940 (+5 ms)Cleaning up detritus from prior splits at 1676300639940Region opened successfully at 1676300639943 (+3 ms) 2023-02-13 15:03:59,944 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 15:03:59,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 15:03:59,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 15:03:59,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 15:03:59,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 15:03:59,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 15:03:59,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 15:03:59,946 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 15:03:59,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 15:03:59,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 15:03:59,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 15:03:59,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 15:03:59,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 15:03:59,961 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 15:03:59,964 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:59,965 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 15:03:59,965 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 15:03:59,966 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 15:03:59,966 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:59,966 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:59,966 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:03:59,966 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:59,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,39335,1676300639778, sessionid=0x1015c5d9fbd0000, setting cluster-up flag (Was=false) 2023-02-13 15:03:59,971 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:59,973 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 15:03:59,973 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:03:59,975 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:03:59,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 15:03:59,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:03:59,977 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.hbase-snapshot/.tmp 2023-02-13 15:03:59,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:03:59,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:03:59,984 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676300669984 2023-02-13 15:03:59,984 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 15:03:59,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 15:03:59,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 15:03:59,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 15:03:59,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 15:03:59,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 15:03:59,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:59,985 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:03:59,985 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 15:03:59,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300639986,5,FailOnTimeoutGroup] 2023-02-13 15:03:59,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300639986,5,FailOnTimeoutGroup] 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:59,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 15:03:59,987 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:03:59,996 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:59,997 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:03:59,997 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e 2023-02-13 15:04:00,004 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:00,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:04:00,008 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/info 2023-02-13 15:04:00,008 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:04:00,009 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:00,009 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:04:00,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:00,010 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:04:00,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:00,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:04:00,011 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/table 2023-02-13 15:04:00,012 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:04:00,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:00,013 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740 2023-02-13 15:04:00,013 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740 2023-02-13 15:04:00,014 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:04:00,015 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:04:00,016 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:00,017 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66519053, jitterRate=-0.00878886878490448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:04:00,017 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676300640004Initializing all the Stores at 1676300640005 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300640005Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300640007 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300640007Cleaning up temporary data from old regions at 1676300640014 (+7 ms)Cleaning up detritus from prior splits at 1676300640014Region opened successfully at 1676300640017 (+3 ms) 2023-02-13 15:04:00,017 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:04:00,017 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:04:00,017 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:04:00,017 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:04:00,017 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:04:00,017 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:00,017 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300640017Disabling compacts and flushes for region at 1676300640017Disabling writes for close at 1676300640017Writing region close event to WAL at 1676300640017Closed at 1676300640017 2023-02-13 15:04:00,018 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:04:00,018 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 15:04:00,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 15:04:00,019 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 15:04:00,020 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 15:04:00,066 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(952): ClusterId : 0edeaa0e-16cb-4855-97a9-59cb95712372 2023-02-13 15:04:00,066 INFO [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(952): ClusterId : 0edeaa0e-16cb-4855-97a9-59cb95712372 2023-02-13 15:04:00,066 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:04:00,066 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:04:00,067 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:04:00,067 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:04:00,067 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:04:00,067 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:04:00,068 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:04:00,069 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:04:00,069 DEBUG [RS:0;jenkins-hbase20:38669] zookeeper.ReadOnlyZKClient(139): Connect 0x49ecf6e4 to 127.0.0.1:50569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:00,070 DEBUG [RS:1;jenkins-hbase20:44817] zookeeper.ReadOnlyZKClient(139): Connect 0x0de64a62 to 127.0.0.1:50569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:00,074 DEBUG [RS:0;jenkins-hbase20:38669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@472b01a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:00,074 DEBUG [RS:1;jenkins-hbase20:44817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@321a5ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:00,075 DEBUG [RS:0;jenkins-hbase20:38669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43149d94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:00,075 DEBUG [RS:1;jenkins-hbase20:44817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71e2112, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:00,081 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:38669 2023-02-13 15:04:00,081 DEBUG [RS:1;jenkins-hbase20:44817] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:44817 2023-02-13 15:04:00,081 INFO [RS:0;jenkins-hbase20:38669] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:04:00,081 INFO [RS:0;jenkins-hbase20:38669] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:04:00,081 INFO [RS:1;jenkins-hbase20:44817] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:04:00,081 INFO [RS:1;jenkins-hbase20:44817] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:04:00,081 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:04:00,081 DEBUG [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:04:00,082 INFO [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,39335,1676300639778 with isa=jenkins-hbase20.apache.org/148.251.75.209:44817, startcode=1676300639847 2023-02-13 15:04:00,082 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,39335,1676300639778 with isa=jenkins-hbase20.apache.org/148.251.75.209:38669, startcode=1676300639815 2023-02-13 15:04:00,082 DEBUG [RS:0;jenkins-hbase20:38669] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:04:00,082 DEBUG [RS:1;jenkins-hbase20:44817] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:04:00,083 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46141, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:04:00,083 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34041, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:04:00,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,085 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39335] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:00,086 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e 2023-02-13 15:04:00,086 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46331 2023-02-13 15:04:00,086 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:04:00,086 DEBUG [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e 2023-02-13 15:04:00,086 DEBUG [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46331 2023-02-13 15:04:00,086 DEBUG [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:04:00,088 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:00,089 DEBUG [RS:0;jenkins-hbase20:38669] zookeeper.ZKUtil(162): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,089 WARN [RS:0;jenkins-hbase20:38669] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:00,089 DEBUG [RS:1;jenkins-hbase20:44817] zookeeper.ZKUtil(162): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:00,089 INFO [RS:0;jenkins-hbase20:38669] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:00,089 WARN [RS:1;jenkins-hbase20:44817] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:00,089 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38669,1676300639815] 2023-02-13 15:04:00,089 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,089 INFO [RS:1;jenkins-hbase20:44817] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:00,089 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44817,1676300639847] 2023-02-13 15:04:00,089 DEBUG [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:00,100 DEBUG [RS:0;jenkins-hbase20:38669] zookeeper.ZKUtil(162): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,100 DEBUG [RS:1;jenkins-hbase20:44817] zookeeper.ZKUtil(162): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,100 DEBUG [RS:0;jenkins-hbase20:38669] zookeeper.ZKUtil(162): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:00,100 DEBUG [RS:1;jenkins-hbase20:44817] zookeeper.ZKUtil(162): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:00,101 DEBUG [RS:1;jenkins-hbase20:44817] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:04:00,101 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:04:00,101 INFO [RS:1;jenkins-hbase20:44817] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:04:00,101 INFO [RS:0;jenkins-hbase20:38669] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:04:00,102 INFO [RS:1;jenkins-hbase20:44817] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:04:00,102 INFO [RS:1;jenkins-hbase20:44817] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:04:00,102 INFO [RS:1;jenkins-hbase20:44817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,103 INFO [RS:0;jenkins-hbase20:38669] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:04:00,107 INFO [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:04:00,107 INFO [RS:0;jenkins-hbase20:38669] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:04:00,108 INFO [RS:0;jenkins-hbase20:38669] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,108 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:04:00,109 INFO [RS:1;jenkins-hbase20:44817] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,109 INFO [RS:0;jenkins-hbase20:38669] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,109 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,109 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:00,109 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:00,110 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,110 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,110 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,110 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,110 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,110 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,110 DEBUG [RS:1;jenkins-hbase20:44817] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,110 DEBUG [RS:0;jenkins-hbase20:38669] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:00,115 INFO [RS:1;jenkins-hbase20:44817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,115 INFO [RS:1;jenkins-hbase20:44817] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,115 INFO [RS:0;jenkins-hbase20:38669] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,115 INFO [RS:1;jenkins-hbase20:44817] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,115 INFO [RS:0;jenkins-hbase20:38669] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,115 INFO [RS:0;jenkins-hbase20:38669] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,127 INFO [RS:1;jenkins-hbase20:44817] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:04:00,127 INFO [RS:1;jenkins-hbase20:44817] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44817,1676300639847-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,129 INFO [RS:0;jenkins-hbase20:38669] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:04:00,129 INFO [RS:0;jenkins-hbase20:38669] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38669,1676300639815-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,140 INFO [RS:1;jenkins-hbase20:44817] regionserver.Replication(203): jenkins-hbase20.apache.org,44817,1676300639847 started 2023-02-13 15:04:00,140 INFO [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,44817,1676300639847, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44817, sessionid=0x1015c5d9fbd0002 2023-02-13 15:04:00,140 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:04:00,140 DEBUG [RS:1;jenkins-hbase20:44817] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:00,140 DEBUG [RS:1;jenkins-hbase20:44817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44817,1676300639847' 2023-02-13 15:04:00,141 DEBUG [RS:1;jenkins-hbase20:44817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:00,141 DEBUG [RS:1;jenkins-hbase20:44817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:00,141 INFO [RS:0;jenkins-hbase20:38669] regionserver.Replication(203): jenkins-hbase20.apache.org,38669,1676300639815 started 2023-02-13 15:04:00,141 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,38669,1676300639815, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38669, sessionid=0x1015c5d9fbd0001 2023-02-13 15:04:00,141 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:04:00,141 DEBUG [RS:0;jenkins-hbase20:38669] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,141 DEBUG [RS:0;jenkins-hbase20:38669] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38669,1676300639815' 2023-02-13 15:04:00,141 DEBUG [RS:0;jenkins-hbase20:38669] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:00,141 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:04:00,141 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:04:00,142 DEBUG [RS:1;jenkins-hbase20:44817] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:00,142 DEBUG [RS:1;jenkins-hbase20:44817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44817,1676300639847' 2023-02-13 15:04:00,142 DEBUG [RS:1;jenkins-hbase20:44817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:00,142 DEBUG [RS:1;jenkins-hbase20:44817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38669,1676300639815' 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:00,142 DEBUG [RS:1;jenkins-hbase20:44817] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:04:00,142 INFO [RS:1;jenkins-hbase20:44817] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:04:00,142 INFO [RS:1;jenkins-hbase20:44817] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:00,142 DEBUG [RS:0;jenkins-hbase20:38669] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:04:00,142 INFO [RS:0;jenkins-hbase20:38669] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:04:00,142 INFO [RS:0;jenkins-hbase20:38669] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:04:00,170 DEBUG [jenkins-hbase20:39335] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 15:04:00,171 DEBUG [jenkins-hbase20:39335] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:00,172 DEBUG [jenkins-hbase20:39335] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:00,172 DEBUG [jenkins-hbase20:39335] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:00,172 DEBUG [jenkins-hbase20:39335] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:00,172 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38669,1676300639815, state=OPENING 2023-02-13 15:04:00,173 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 15:04:00,174 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:00,174 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:04:00,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38669,1676300639815}] 2023-02-13 15:04:00,330 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,330 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:04:00,331 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38982, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:04:00,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 15:04:00,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:00,336 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38669%2C1676300639815.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,38669,1676300639815, archiveDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/oldWALs, maxLogs=32 2023-02-13 15:04:00,347 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK] 2023-02-13 15:04:00,347 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK] 2023-02-13 15:04:00,349 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,38669,1676300639815/jenkins-hbase20.apache.org%2C38669%2C1676300639815.meta.1676300640336.meta 2023-02-13 15:04:00,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK], DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK]] 2023-02-13 15:04:00,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:00,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 15:04:00,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 15:04:00,350 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 15:04:00,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 15:04:00,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:00,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 15:04:00,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 15:04:00,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:04:00,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/info 2023-02-13 15:04:00,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/info 2023-02-13 15:04:00,352 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:04:00,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:00,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:04:00,353 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:00,353 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:00,353 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:04:00,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:00,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:04:00,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/table 2023-02-13 15:04:00,355 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/table 2023-02-13 15:04:00,355 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:04:00,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:00,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740 2023-02-13 15:04:00,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740 2023-02-13 15:04:00,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:04:00,359 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:04:00,360 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62660044, jitterRate=-0.06629258394241333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:04:00,360 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676300640350Writing region info on filesystem at 1676300640350Initializing all the Stores at 1676300640351 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300640351Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300640351Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300640351Cleaning up temporary data from old regions at 1676300640357 (+6 ms)Cleaning up detritus from prior splits at 1676300640358 (+1 ms)Running coprocessor post-open hooks at 1676300640360 (+2 ms)Region opened successfully at 1676300640360 2023-02-13 15:04:00,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676300640330 2023-02-13 15:04:00,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 15:04:00,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 15:04:00,365 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38669,1676300639815, state=OPEN 2023-02-13 15:04:00,366 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 15:04:00,366 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:04:00,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 15:04:00,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38669,1676300639815 in 192 msec 2023-02-13 15:04:00,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 15:04:00,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 349 msec 2023-02-13 15:04:00,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-13 15:04:00,370 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676300639870, completionTime=-1 2023-02-13 15:04:00,370 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 15:04:00,370 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 15:04:00,373 DEBUG [hconnection-0x3db52d42-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:00,374 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:00,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 15:04:00,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676300700376 2023-02-13 15:04:00,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676300760376 2023-02-13 15:04:00,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-13 15:04:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39335,1676300639778-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39335,1676300639778-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39335,1676300639778-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:39335, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 15:04:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:00,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 15:04:00,386 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 15:04:00,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:04:00,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:04:00,387 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,388 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9 empty. 2023-02-13 15:04:00,388 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,388 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 15:04:00,396 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:00,397 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f9c5c378056be4338c2220ced653fef9, NAME => 'hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp 2023-02-13 15:04:00,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:00,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f9c5c378056be4338c2220ced653fef9, disabling compactions & flushes 2023-02-13 15:04:00,405 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:00,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:00,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. after waiting 0 ms 2023-02-13 15:04:00,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:00,405 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:00,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f9c5c378056be4338c2220ced653fef9: Waiting for close lock at 1676300640405Disabling compacts and flushes for region at 1676300640405Disabling writes for close at 1676300640405Writing region close event to WAL at 1676300640405Closed at 1676300640405 2023-02-13 15:04:00,406 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:04:00,407 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300640407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300640407"}]},"ts":"1676300640407"} 2023-02-13 15:04:00,410 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:04:00,410 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:04:00,411 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300640410"}]},"ts":"1676300640410"} 2023-02-13 15:04:00,412 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 15:04:00,414 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:00,414 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:00,414 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:00,414 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:00,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f9c5c378056be4338c2220ced653fef9, ASSIGN}] 2023-02-13 15:04:00,417 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f9c5c378056be4338c2220ced653fef9, ASSIGN 2023-02-13 15:04:00,417 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f9c5c378056be4338c2220ced653fef9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38669,1676300639815; forceNewPlan=false, retain=false 2023-02-13 15:04:00,568 INFO [jenkins-hbase20:39335] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:04:00,568 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f9c5c378056be4338c2220ced653fef9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,568 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300640568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300640568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300640568"}]},"ts":"1676300640568"} 2023-02-13 15:04:00,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f9c5c378056be4338c2220ced653fef9, server=jenkins-hbase20.apache.org,38669,1676300639815}] 2023-02-13 15:04:00,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:00,727 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38669%2C1676300639815, suffix=, logDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,38669,1676300639815, archiveDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/oldWALs, maxLogs=32 2023-02-13 15:04:00,738 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK] 2023-02-13 15:04:00,738 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK] 2023-02-13 15:04:00,739 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,38669,1676300639815/jenkins-hbase20.apache.org%2C38669%2C1676300639815.1676300640727 2023-02-13 15:04:00,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK], DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK]] 2023-02-13 15:04:00,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f9c5c378056be4338c2220ced653fef9, NAME => 'hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:00,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:00,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,741 INFO [StoreOpener-f9c5c378056be4338c2220ced653fef9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,742 DEBUG [StoreOpener-f9c5c378056be4338c2220ced653fef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/info 2023-02-13 15:04:00,742 DEBUG [StoreOpener-f9c5c378056be4338c2220ced653fef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/info 2023-02-13 15:04:00,743 INFO [StoreOpener-f9c5c378056be4338c2220ced653fef9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9c5c378056be4338c2220ced653fef9 columnFamilyName info 2023-02-13 15:04:00,743 INFO [StoreOpener-f9c5c378056be4338c2220ced653fef9-1] regionserver.HStore(310): Store=f9c5c378056be4338c2220ced653fef9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:00,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:00,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:00,747 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f9c5c378056be4338c2220ced653fef9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68428144, jitterRate=0.019658803939819336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:04:00,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f9c5c378056be4338c2220ced653fef9: Running coprocessor pre-open hook at 1676300640740Writing region info on filesystem at 1676300640740Initializing all the Stores at 1676300640741 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300640741Cleaning up temporary data from old regions at 1676300640744 (+3 ms)Cleaning up detritus from prior splits at 1676300640744Running coprocessor post-open hooks at 1676300640747 (+3 ms)Region opened successfully at 1676300640747 2023-02-13 15:04:00,748 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9., pid=6, masterSystemTime=1676300640721 2023-02-13 15:04:00,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:00,750 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:00,750 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f9c5c378056be4338c2220ced653fef9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:00,750 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300640750"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300640750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300640750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300640750"}]},"ts":"1676300640750"} 2023-02-13 15:04:00,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 15:04:00,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f9c5c378056be4338c2220ced653fef9, server=jenkins-hbase20.apache.org,38669,1676300639815 in 182 msec 2023-02-13 15:04:00,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 15:04:00,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f9c5c378056be4338c2220ced653fef9, ASSIGN in 339 msec 2023-02-13 15:04:00,754 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:04:00,755 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300640754"}]},"ts":"1676300640754"} 2023-02-13 15:04:00,756 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 15:04:00,757 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:04:00,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-02-13 15:04:00,785 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 15:04:00,786 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:00,786 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:00,790 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 15:04:00,797 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:00,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 15:04:00,801 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 15:04:00,807 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:00,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-13 15:04:00,815 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 15:04:00,816 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 15:04:00,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.942sec 2023-02-13 15:04:00,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 15:04:00,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 15:04:00,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 15:04:00,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39335,1676300639778-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 15:04:00,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39335,1676300639778-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 15:04:00,818 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 15:04:00,866 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ReadOnlyZKClient(139): Connect 0x3a727b00 to 127.0.0.1:50569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:00,878 DEBUG [Listener at localhost.localdomain/35289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49f3c002, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:00,879 DEBUG [hconnection-0x309a876d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:00,881 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:00,882 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:04:00,882 DEBUG [Listener at localhost.localdomain/35289] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 15:04:00,884 DEBUG [Listener at localhost.localdomain/35289] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 15:04:00,886 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54636, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 15:04:00,886 INFO [Listener at localhost.localdomain/35289] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 15:04:00,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-13 15:04:00,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:04:00,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 148.251.75.209:54636 deadline: 1676300700887, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-13 15:04:00,888 INFO [Listener at localhost.localdomain/35289] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-13 15:04:00,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:00,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:00,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:04:00,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-13 15:04:00,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:00,894 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:04:00,895 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:00,896 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd empty. 2023-02-13 15:04:00,896 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:00,896 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 15:04:00,903 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:00,904 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c187050dafb4b947c3ad9784ad4c4dd, NAME => 'testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp 2023-02-13 15:04:00,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:00,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 9c187050dafb4b947c3ad9784ad4c4dd, disabling compactions & flushes 2023-02-13 15:04:00,909 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:00,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:00,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. after waiting 0 ms 2023-02-13 15:04:00,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:00,909 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:00,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 9c187050dafb4b947c3ad9784ad4c4dd: Waiting for close lock at 1676300640909Disabling compacts and flushes for region at 1676300640909Disabling writes for close at 1676300640909Writing region close event to WAL at 1676300640909Closed at 1676300640909 2023-02-13 15:04:00,911 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:04:00,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676300640912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300640912"}]},"ts":"1676300640912"} 2023-02-13 15:04:00,913 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:04:00,913 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:04:00,913 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300640913"}]},"ts":"1676300640913"} 2023-02-13 15:04:00,914 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-13 15:04:00,916 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:00,917 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:00,917 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:00,917 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:00,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=9c187050dafb4b947c3ad9784ad4c4dd, ASSIGN}] 2023-02-13 15:04:00,919 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=9c187050dafb4b947c3ad9784ad4c4dd, ASSIGN 2023-02-13 15:04:00,920 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=9c187050dafb4b947c3ad9784ad4c4dd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44817,1676300639847; forceNewPlan=false, retain=false 2023-02-13 15:04:00,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:01,070 INFO [jenkins-hbase20:39335] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:04:01,070 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9c187050dafb4b947c3ad9784ad4c4dd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,070 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676300641070"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300641070"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300641070"}]},"ts":"1676300641070"} 2023-02-13 15:04:01,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 9c187050dafb4b947c3ad9784ad4c4dd, server=jenkins-hbase20.apache.org,44817,1676300639847}] 2023-02-13 15:04:01,144 INFO [RS:1;jenkins-hbase20:44817] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44817%2C1676300639847, suffix=, logDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,44817,1676300639847, archiveDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/oldWALs, maxLogs=32 2023-02-13 15:04:01,207 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK] 2023-02-13 15:04:01,207 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK] 2023-02-13 15:04:01,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:01,211 INFO [RS:1;jenkins-hbase20:44817] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/WALs/jenkins-hbase20.apache.org,44817,1676300639847/jenkins-hbase20.apache.org%2C44817%2C1676300639847.1676300641144 2023-02-13 15:04:01,211 DEBUG [RS:1;jenkins-hbase20:44817] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44705,DS-21b07671-c13a-4bb9-bc8f-df2ddcc6edaf,DISK], DatanodeInfoWithStorage[127.0.0.1:40719,DS-4bd1d9ff-2f75-42cf-a4a9-f95ed267cc89,DISK]] 2023-02-13 15:04:01,224 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,224 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:04:01,226 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48424, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:04:01,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:01,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c187050dafb4b947c3ad9784ad4c4dd, NAME => 'testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:01,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:01,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,231 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,232 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1 2023-02-13 15:04:01,232 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1 2023-02-13 15:04:01,232 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c187050dafb4b947c3ad9784ad4c4dd columnFamilyName f1 2023-02-13 15:04:01,233 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(310): Store=9c187050dafb4b947c3ad9784ad4c4dd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:01,233 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,234 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2 2023-02-13 15:04:01,234 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2 2023-02-13 15:04:01,234 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c187050dafb4b947c3ad9784ad4c4dd columnFamilyName f2 2023-02-13 15:04:01,234 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(310): Store=9c187050dafb4b947c3ad9784ad4c4dd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:01,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:04:01,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:01,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:01,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9c187050dafb4b947c3ad9784ad4c4dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74962867, jitterRate=0.11703376471996307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:04:01,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9c187050dafb4b947c3ad9784ad4c4dd: Running coprocessor pre-open hook at 1676300641229Writing region info on filesystem at 1676300641229Initializing all the Stores at 1676300641230 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300641230Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300641231 (+1 ms)Cleaning up temporary data from old regions at 1676300641236 (+5 ms)Cleaning up detritus from prior splits at 1676300641236Running coprocessor post-open hooks at 1676300641240 (+4 ms)Region opened successfully at 1676300641240 2023-02-13 15:04:01,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd., pid=12, masterSystemTime=1676300641224 2023-02-13 15:04:01,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:01,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:01,247 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9c187050dafb4b947c3ad9784ad4c4dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,247 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676300641247"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300641247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300641247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300641247"}]},"ts":"1676300641247"} 2023-02-13 15:04:01,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 15:04:01,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 9c187050dafb4b947c3ad9784ad4c4dd, server=jenkins-hbase20.apache.org,44817,1676300639847 in 177 msec 2023-02-13 15:04:01,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 15:04:01,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=9c187050dafb4b947c3ad9784ad4c4dd, ASSIGN in 333 msec 2023-02-13 15:04:01,253 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:04:01,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300641253"}]},"ts":"1676300641253"} 2023-02-13 15:04:01,254 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-13 15:04:01,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:04:01,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 365 msec 2023-02-13 15:04:01,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:01,509 INFO [Listener at localhost.localdomain/35289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-13 15:04:01,510 DEBUG [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-13 15:04:01,510 INFO [Listener at localhost.localdomain/35289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:04:01,511 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-13 15:04:01,512 INFO [Listener at localhost.localdomain/35289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:04:01,512 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-13 15:04:01,512 INFO [Listener at localhost.localdomain/35289] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 15:04:01,523 DEBUG [hconnection-0x309a876d-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:01,533 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48438, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:01,539 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:01,612 INFO [Listener at localhost.localdomain/35289] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 15:04:01,612 INFO [Listener at localhost.localdomain/35289] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 15:04:01,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 15:04:01,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676300641613 (current time:1676300641613). 2023-02-13 15:04:01,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 15:04:01,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] zookeeper.ReadOnlyZKClient(139): Connect 0x18d9e229 to 127.0.0.1:50569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:01,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30a23f5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:01,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:01,618 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:01,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18d9e229 to 127.0.0.1:50569 2023-02-13 15:04:01,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:01,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 15:04:01,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 15:04:01,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 15:04:01,622 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 15:04:01,622 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676301241622 2023-02-13 15:04:01,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 15:04:01,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,625 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 15:04:01,625 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 15:04:01,625 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 15:04:01,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 15:04:01,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-13 15:04:01,627 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 15:04:01,627 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676301241627 2023-02-13 15:04:01,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,639 INFO [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 15:04:01,639 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:01,640 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 15:04:01,640 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 15:04:01,640 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,640 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,641 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:01,641 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:01,641 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:01,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:01,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:01,642 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,642 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 15:04:01,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 15:04:01,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,643 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 15:04:01,643 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:01,643 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 15:04:01,644 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 15:04:01,644 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 15:04:01,644 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:01,644 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44817,1676300639847' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 15:04:01,644 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 15:04:01,644 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 15:04:01,644 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38669,1676300639815' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 15:04:01,645 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,645 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,645 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:01,645 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,645 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:01,645 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,646 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:01,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44817,1676300639847' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 15:04:01,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58a63fe[Count = 0] remaining members to acquire global barrier 2023-02-13 15:04:01,647 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 15:04:01,647 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,647 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,647 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,38669,1676300639815' in zk 2023-02-13 15:04:01,648 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,648 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:04:01,648 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:01,648 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. started... 2023-02-13 15:04:01,648 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9c187050dafb4b947c3ad9784ad4c4dd 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:01,648 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 15:04:01,662 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f1/d409d26d95564c8494efea4c695bd6e4 2023-02-13 15:04:01,677 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f2/0adc5db50e5b4a7aa8864f3d4947e7ff 2023-02-13 15:04:01,680 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f1/d409d26d95564c8494efea4c695bd6e4 as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/d409d26d95564c8494efea4c695bd6e4 2023-02-13 15:04:01,683 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/d409d26d95564c8494efea4c695bd6e4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:04:01,684 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f2/0adc5db50e5b4a7aa8864f3d4947e7ff as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/0adc5db50e5b4a7aa8864f3d4947e7ff 2023-02-13 15:04:01,687 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/0adc5db50e5b4a7aa8864f3d4947e7ff, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:04:01,688 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 9c187050dafb4b947c3ad9784ad4c4dd in 40ms, sequenceid=5, compaction requested=false 2023-02-13 15:04:01,688 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-13 15:04:01,689 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9c187050dafb4b947c3ad9784ad4c4dd: 2023-02-13 15:04:01,689 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,689 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:04:01,689 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/d409d26d95564c8494efea4c695bd6e4] hfiles 2023-02-13 15:04:01,689 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/d409d26d95564c8494efea4c695bd6e4 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,689 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/0adc5db50e5b4a7aa8864f3d4947e7ff] hfiles 2023-02-13 15:04:01,689 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/0adc5db50e5b4a7aa8864f3d4947e7ff for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,694 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. completed. 2023-02-13 15:04:01,694 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:01,694 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 15:04:01,694 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 15:04:01,694 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,694 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 15:04:01,694 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,44817,1676300639847' in zk 2023-02-13 15:04:01,695 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,695 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 15:04:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:01,696 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:01,696 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 15:04:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,44817,1676300639847': 2023-02-13 15:04:01,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44817,1676300639847' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 15:04:01,698 INFO [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 15:04:01,698 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:04:01,698 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:04:01,698 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,698 INFO [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 15:04:01,699 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,699 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,699 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:01,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,699 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:01,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,699 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:01,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:01,700 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,700 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,701 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,702 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,706 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,706 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,706 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:01,706 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:01,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:01,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion because node does not exist (not an error) 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,707 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:01,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,707 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:01,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,725 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:01,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 15:04:01,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:04:01,727 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 15:04:01,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-13 15:04:01,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,739 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:01,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676300641623Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676300641707 (+84 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676300641707Writing data manifest for testWithMockedMapReduceSingleRegion at 1676300641709 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676300641715 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676300641739 (+24 ms) 2023-02-13 15:04:01,741 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 15:04:01,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 117 msec 2023-02-13 15:04:01,927 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:01,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 15:04:01,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 15:04:01,928 INFO [Listener at localhost.localdomain/35289] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 15:04:01,932 INFO [Listener at localhost.localdomain/35289] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 15:04:01,936 INFO [Listener at localhost.localdomain/35289] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 15:04:01,960 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,040 INFO [Listener at localhost.localdomain/35289] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 15:04:02,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 15:04:02,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,052 INFO [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 15:04:02,052 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:02,053 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 15:04:02,053 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 15:04:02,054 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,054 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,054 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:02,054 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:02,054 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:02,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:02,055 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,055 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,055 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,063 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 15:04:02,063 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:02,064 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 15:04:02,064 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 15:04:02,064 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:02,064 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 15:04:02,064 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:04:02,064 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 15:04:02,064 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 15:04:02,064 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,065 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38669,1676300639815' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 15:04:02,065 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. started... 2023-02-13 15:04:02,065 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c187050dafb4b947c3ad9784ad4c4dd 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 15:04:02,078 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,078 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,078 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:02,090 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f1/faaad31193814730a449b756ea2fd5cf 2023-02-13 15:04:02,109 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f2/c6d1e5e4589746c488afd5799ab48766 2023-02-13 15:04:02,113 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f1/faaad31193814730a449b756ea2fd5cf as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/faaad31193814730a449b756ea2fd5cf 2023-02-13 15:04:02,117 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/faaad31193814730a449b756ea2fd5cf, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:04:02,118 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/.tmp/f2/c6d1e5e4589746c488afd5799ab48766 as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/c6d1e5e4589746c488afd5799ab48766 2023-02-13 15:04:02,123 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/c6d1e5e4589746c488afd5799ab48766, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:04:02,124 INFO [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 9c187050dafb4b947c3ad9784ad4c4dd in 59ms, sequenceid=9, compaction requested=false 2023-02-13 15:04:02,125 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c187050dafb4b947c3ad9784ad4c4dd: 2023-02-13 15:04:02,125 DEBUG [rs(jenkins-hbase20.apache.org,44817,1676300639847)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,125 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 15:04:02,125 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 15:04:02,125 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,125 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 15:04:02,125 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44817,1676300639847' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 15:04:02,126 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,126 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:02,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:02,127 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,127 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:02,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44817,1676300639847' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 15:04:02,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b5f797[Count = 0] remaining members to acquire global barrier 2023-02-13 15:04:02,128 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 15:04:02,128 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,129 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,129 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,129 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 15:04:02,129 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 15:04:02,129 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,38669,1676300639815' in zk 2023-02-13 15:04:02,129 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 15:04:02,129 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 15:04:02,129 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,44817,1676300639847' in zk 2023-02-13 15:04:02,130 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,130 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:04:02,130 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,130 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 15:04:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:02,130 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:02,130 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 15:04:02,131 DEBUG [member: 'jenkins-hbase20.apache.org,38669,1676300639815' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 15:04:02,131 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:02,131 DEBUG [member: 'jenkins-hbase20.apache.org,44817,1676300639847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 15:04:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,44817,1676300639847': 2023-02-13 15:04:02,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44817,1676300639847' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 15:04:02,133 INFO [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 15:04:02,133 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:04:02,133 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:04:02,133 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,133 INFO [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 15:04:02,134 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,134 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:02,134 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,134 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,134 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,135 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:02,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:02,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:02,135 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,136 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,136 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-13 15:04:02,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 15:04:02,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:02,138 DEBUG [(jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:02,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-13 15:04:02,138 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,139 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 15:04:02,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:02,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:02,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:02,139 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:02,139 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,139 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,139 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,139 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,239 DEBUG [Listener at localhost.localdomain/35289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 15:04:02,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 15:04:02,245 INFO [Listener at localhost.localdomain/35289] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676300641613 type: FLUSH version: 2 ttl: 0 2023-02-13 15:04:02,245 DEBUG [Listener at localhost.localdomain/35289] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc/data/default/testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,246 INFO [Listener at localhost.localdomain/35289] snapshot.RestoreSnapshotHelper(239): region to add: 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:02,246 INFO [Listener at localhost.localdomain/35289] snapshot.RestoreSnapshotHelper(585): clone region=9c187050dafb4b947c3ad9784ad4c4dd as 9c187050dafb4b947c3ad9784ad4c4dd in snapshot testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,247 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c187050dafb4b947c3ad9784ad4c4dd, NAME => 'testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc 2023-02-13 15:04:02,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:02,265 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d409d26d95564c8494efea4c695bd6e4 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,267 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0adc5db50e5b4a7aa8864f3d4947e7ff from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,270 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9c187050dafb4b947c3ad9784ad4c4dd, disabling compactions & flushes 2023-02-13 15:04:02,270 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,270 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,270 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. after waiting 0 ms 2023-02-13 15:04:02,270 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,270 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,270 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9c187050dafb4b947c3ad9784ad4c4dd: Waiting for close lock at 1676300642269Disabling compacts and flushes for region at 1676300642270 (+1 ms)Disabling writes for close at 1676300642270Writing region close event to WAL at 1676300642270Closed at 1676300642270 2023-02-13 15:04:02,270 INFO [Listener at localhost.localdomain/35289] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676300641613 type: FLUSH version: 2 ttl: 0 2023-02-13 15:04:02,270 DEBUG [Listener at localhost.localdomain/35289] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc 2023-02-13 15:04:02,270 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc 2023-02-13 15:04:02,271 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(699): |-data/ 2023-02-13 15:04:02,271 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(699): |----default/ 2023-02-13 15:04:02,271 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-13 15:04:02,272 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(699): |----------9c187050dafb4b947c3ad9784ad4c4dd/ 2023-02-13 15:04:02,272 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:04:02,272 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:04:02,272 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=9c187050dafb4b947c3ad9784ad4c4dd-d409d26d95564c8494efea4c695bd6e4 2023-02-13 15:04:02,272 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:04:02,273 DEBUG [Listener at localhost.localdomain/35289] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=9c187050dafb4b947c3ad9784ad4c4dd-0adc5db50e5b4a7aa8864f3d4947e7ff 2023-02-13 15:04:02,276 INFO [Listener at localhost.localdomain/35289] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 15:04:02,279 DEBUG [Listener at localhost.localdomain/35289] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:02,279 INFO [Listener at localhost.localdomain/35289] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:04:02,279 DEBUG [Listener at localhost.localdomain/35289] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:04:02,282 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:02,283 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1 2023-02-13 15:04:02,283 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c187050dafb4b947c3ad9784ad4c4dd columnFamilyName f1 2023-02-13 15:04:02,287 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/testWithMockedMapReduceSingleRegion=9c187050dafb4b947c3ad9784ad4c4dd-d409d26d95564c8494efea4c695bd6e4 2023-02-13 15:04:02,287 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(310): Store=9c187050dafb4b947c3ad9784ad4c4dd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:02,287 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:02,288 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2 2023-02-13 15:04:02,288 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c187050dafb4b947c3ad9784ad4c4dd columnFamilyName f2 2023-02-13 15:04:02,292 DEBUG [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46331/user/jenkins/test-data/458a9858-b0ff-f91e-acfe-941c3cff09ca/testWithMockedMapReduceSingleRegion/bf6d40cf-0a6e-4dbb-b8e3-f1f6639ea1cc/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/testWithMockedMapReduceSingleRegion=9c187050dafb4b947c3ad9784ad4c4dd-0adc5db50e5b4a7aa8864f3d4947e7ff 2023-02-13 15:04:02,292 INFO [StoreOpener-9c187050dafb4b947c3ad9784ad4c4dd-1] regionserver.HStore(310): Store=9c187050dafb4b947c3ad9784ad4c4dd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:02,292 DEBUG [Listener at localhost.localdomain/35289] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:04:02,293 INFO [Listener at localhost.localdomain/35289] regionserver.HRegion(1071): Opened 9c187050dafb4b947c3ad9784ad4c4dd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58919878, jitterRate=-0.12202540040016174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:04:02,293 DEBUG [Listener at localhost.localdomain/35289] regionserver.HRegion(964): Region open journal for 9c187050dafb4b947c3ad9784ad4c4dd: Writing region info on filesystem at 1676300642280Initializing all the Stores at 1676300642280Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300642280Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300642280Region opened successfully at 1676300642293 (+13 ms) 2023-02-13 15:04:02,338 DEBUG [Listener at localhost.localdomain/35289] regionserver.HRegion(1603): Closing 9c187050dafb4b947c3ad9784ad4c4dd, disabling compactions & flushes 2023-02-13 15:04:02,338 INFO [Listener at localhost.localdomain/35289] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,338 DEBUG [Listener at localhost.localdomain/35289] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,338 DEBUG [Listener at localhost.localdomain/35289] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. after waiting 0 ms 2023-02-13 15:04:02,338 DEBUG [Listener at localhost.localdomain/35289] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,339 INFO [Listener at localhost.localdomain/35289] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,339 DEBUG [Listener at localhost.localdomain/35289] regionserver.HRegion(1557): Region close journal for 9c187050dafb4b947c3ad9784ad4c4dd: Waiting for close lock at 1676300642338Disabling compacts and flushes for region at 1676300642338Disabling writes for close at 1676300642338Writing region close event to WAL at 1676300642339 (+1 ms)Closed at 1676300642339 2023-02-13 15:04:02,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-13 15:04:02,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,346 INFO [Listener at localhost.localdomain/35289] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300642350"}]},"ts":"1676300642350"} 2023-02-13 15:04:02,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:02,351 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-13 15:04:02,352 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-13 15:04:02,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=9c187050dafb4b947c3ad9784ad4c4dd, UNASSIGN}] 2023-02-13 15:04:02,354 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=9c187050dafb4b947c3ad9784ad4c4dd, UNASSIGN 2023-02-13 15:04:02,354 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9c187050dafb4b947c3ad9784ad4c4dd, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,355 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676300642354"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300642354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300642354"}]},"ts":"1676300642354"} 2023-02-13 15:04:02,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 9c187050dafb4b947c3ad9784ad4c4dd, server=jenkins-hbase20.apache.org,44817,1676300639847}] 2023-02-13 15:04:02,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:02,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:02,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9c187050dafb4b947c3ad9784ad4c4dd, disabling compactions & flushes 2023-02-13 15:04:02,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. after waiting 0 ms 2023-02-13 15:04:02,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:04:02,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd. 2023-02-13 15:04:02,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9c187050dafb4b947c3ad9784ad4c4dd: Waiting for close lock at 1676300642508Running coprocessor pre-close hooks at 1676300642508Disabling compacts and flushes for region at 1676300642508Disabling writes for close at 1676300642508Writing region close event to WAL at 1676300642509 (+1 ms)Running coprocessor post-close hooks at 1676300642512 (+3 ms)Closed at 1676300642512 2023-02-13 15:04:02,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:02,514 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9c187050dafb4b947c3ad9784ad4c4dd, regionState=CLOSED 2023-02-13 15:04:02,514 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676300642514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300642514"}]},"ts":"1676300642514"} 2023-02-13 15:04:02,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 15:04:02,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 9c187050dafb4b947c3ad9784ad4c4dd, server=jenkins-hbase20.apache.org,44817,1676300639847 in 160 msec 2023-02-13 15:04:02,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 15:04:02,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=9c187050dafb4b947c3ad9784ad4c4dd, UNASSIGN in 164 msec 2023-02-13 15:04:02,518 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300642518"}]},"ts":"1676300642518"} 2023-02-13 15:04:02,519 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-13 15:04:02,521 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-13 15:04:02,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 174 msec 2023-02-13 15:04:02,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:02,653 INFO [Listener at localhost.localdomain/35289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-13 15:04:02,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,656 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,656 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:04:02,659 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:02,661 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1, FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2, FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/recovered.edits] 2023-02-13 15:04:02,664 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/d409d26d95564c8494efea4c695bd6e4 to hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/archive/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/d409d26d95564c8494efea4c695bd6e4 2023-02-13 15:04:02,665 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/faaad31193814730a449b756ea2fd5cf to hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/archive/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f1/faaad31193814730a449b756ea2fd5cf 2023-02-13 15:04:02,668 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/0adc5db50e5b4a7aa8864f3d4947e7ff to hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/archive/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/0adc5db50e5b4a7aa8864f3d4947e7ff 2023-02-13 15:04:02,669 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/c6d1e5e4589746c488afd5799ab48766 to hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/archive/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/f2/c6d1e5e4589746c488afd5799ab48766 2023-02-13 15:04:02,671 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/recovered.edits/12.seqid to hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/archive/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd/recovered.edits/12.seqid 2023-02-13 15:04:02,671 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/.tmp/data/default/testWithMockedMapReduceSingleRegion/9c187050dafb4b947c3ad9784ad4c4dd 2023-02-13 15:04:02,672 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 15:04:02,673 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,674 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-13 15:04:02,676 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-13 15:04:02,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-13 15:04:02,677 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300642677"}]},"ts":"9223372036854775807"} 2023-02-13 15:04:02,678 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 15:04:02,678 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c187050dafb4b947c3ad9784ad4c4dd, NAME => 'testWithMockedMapReduceSingleRegion,,1676300640890.9c187050dafb4b947c3ad9784ad4c4dd.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 15:04:02,678 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-13 15:04:02,678 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676300642678"}]},"ts":"9223372036854775807"} 2023-02-13 15:04:02,680 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-13 15:04:02,681 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 15:04:02,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 27 msec 2023-02-13 15:04:02,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:04:02,759 INFO [Listener at localhost.localdomain/35289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-13 15:04:02,759 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 15:04:02,759 INFO [Listener at localhost.localdomain/35289] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 15:04:02,759 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a727b00 to 127.0.0.1:50569 2023-02-13 15:04:02,760 DEBUG [Listener at localhost.localdomain/35289] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:02,760 DEBUG [Listener at localhost.localdomain/35289] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 15:04:02,760 DEBUG [Listener at localhost.localdomain/35289] util.JVMClusterUtil(257): Found active master hash=1642918201, stopped=false 2023-02-13 15:04:02,760 INFO [Listener at localhost.localdomain/35289] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:04:02,760 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:02,761 INFO [Listener at localhost.localdomain/35289] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 15:04:02,760 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:02,760 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:02,762 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:02,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:02,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:02,762 DEBUG [Listener at localhost.localdomain/35289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x524785f9 to 127.0.0.1:50569 2023-02-13 15:04:02,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:02,762 DEBUG [Listener at localhost.localdomain/35289] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:02,762 INFO [Listener at localhost.localdomain/35289] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,38669,1676300639815' ***** 2023-02-13 15:04:02,762 INFO [Listener at localhost.localdomain/35289] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:04:02,762 INFO [Listener at localhost.localdomain/35289] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44817,1676300639847' ***** 2023-02-13 15:04:02,762 INFO [Listener at localhost.localdomain/35289] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:04:02,762 INFO [RS:0;jenkins-hbase20:38669] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:04:02,763 INFO [RS:1;jenkins-hbase20:44817] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:04:02,763 INFO [RS:0;jenkins-hbase20:38669] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:04:02,763 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:04:02,763 INFO [RS:0;jenkins-hbase20:38669] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:04:02,763 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:04:02,764 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(3304): Received CLOSE for f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:02,763 INFO [RS:1;jenkins-hbase20:44817] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:04:02,765 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,765 INFO [RS:1;jenkins-hbase20:44817] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:04:02,765 DEBUG [RS:0;jenkins-hbase20:38669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49ecf6e4 to 127.0.0.1:50569 2023-02-13 15:04:02,765 INFO [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f9c5c378056be4338c2220ced653fef9, disabling compactions & flushes 2023-02-13 15:04:02,765 DEBUG [RS:1;jenkins-hbase20:44817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0de64a62 to 127.0.0.1:50569 2023-02-13 15:04:02,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:02,765 DEBUG [RS:0;jenkins-hbase20:38669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:02,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:02,765 INFO [RS:0;jenkins-hbase20:38669] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:04:02,765 DEBUG [RS:1;jenkins-hbase20:44817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:02,765 INFO [RS:0;jenkins-hbase20:38669] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:04:02,765 INFO [RS:0;jenkins-hbase20:38669] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:04:02,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. after waiting 0 ms 2023-02-13 15:04:02,765 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 15:04:02,765 INFO [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44817,1676300639847; all regions closed. 2023-02-13 15:04:02,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:02,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing f9c5c378056be4338c2220ced653fef9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 15:04:02,765 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 15:04:02,766 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1479): Online Regions={f9c5c378056be4338c2220ced653fef9=hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9., 1588230740=hbase:meta,,1.1588230740} 2023-02-13 15:04:02,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:04:02,766 DEBUG [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1505): Waiting on 1588230740, f9c5c378056be4338c2220ced653fef9 2023-02-13 15:04:02,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:04:02,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:04:02,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:04:02,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:04:02,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-13 15:04:02,769 DEBUG [RS:1;jenkins-hbase20:44817] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/oldWALs 2023-02-13 15:04:02,769 INFO [RS:1;jenkins-hbase20:44817] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44817%2C1676300639847:(num 1676300641144) 2023-02-13 15:04:02,769 DEBUG [RS:1;jenkins-hbase20:44817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:02,769 INFO [RS:1;jenkins-hbase20:44817] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:02,769 INFO [RS:1;jenkins-hbase20:44817] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:04:02,769 INFO [RS:1;jenkins-hbase20:44817] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:04:02,769 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:02,769 INFO [RS:1;jenkins-hbase20:44817] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:04:02,769 INFO [RS:1;jenkins-hbase20:44817] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:04:02,770 INFO [RS:1;jenkins-hbase20:44817] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44817 2023-02-13 15:04:02,772 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,772 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@256fcc3e rejected from java.util.concurrent.ThreadPoolExecutor@21504c4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:02,772 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:02,772 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:02,772 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44817,1676300639847 2023-02-13 15:04:02,772 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e29a44b rejected from java.util.concurrent.ThreadPoolExecutor@21504c4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:02,772 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:02,773 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44817,1676300639847] 2023-02-13 15:04:02,773 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44817,1676300639847; numProcessing=1 2023-02-13 15:04:02,773 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44817,1676300639847 already deleted, retry=false 2023-02-13 15:04:02,773 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44817,1676300639847 expired; onlineServers=1 2023-02-13 15:04:02,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/.tmp/info/22f6674b96844ae6b618b08ccf09020d 2023-02-13 15:04:02,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.58 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/.tmp/info/f987d5bc494e4001bd9f2ecc7d9498af 2023-02-13 15:04:02,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/.tmp/info/22f6674b96844ae6b618b08ccf09020d as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/info/22f6674b96844ae6b618b08ccf09020d 2023-02-13 15:04:02,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f987d5bc494e4001bd9f2ecc7d9498af 2023-02-13 15:04:02,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/info/22f6674b96844ae6b618b08ccf09020d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 15:04:02,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f9c5c378056be4338c2220ced653fef9 in 19ms, sequenceid=6, compaction requested=false 2023-02-13 15:04:02,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/namespace/f9c5c378056be4338c2220ced653fef9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 15:04:02,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:02,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f9c5c378056be4338c2220ced653fef9: Waiting for close lock at 1676300642765Running coprocessor pre-close hooks at 1676300642765Disabling compacts and flushes for region at 1676300642765Disabling writes for close at 1676300642765Obtaining lock to block concurrent updates at 1676300642765Preparing flush snapshotting stores in f9c5c378056be4338c2220ced653fef9 at 1676300642765Finished memstore snapshotting hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676300642766 (+1 ms)Flushing stores of hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. at 1676300642766Flushing f9c5c378056be4338c2220ced653fef9/info: creating writer at 1676300642767 (+1 ms)Flushing f9c5c378056be4338c2220ced653fef9/info: appending metadata at 1676300642769 (+2 ms)Flushing f9c5c378056be4338c2220ced653fef9/info: closing flushed file at 1676300642769Flushing f9c5c378056be4338c2220ced653fef9/info: reopening flushed file at 1676300642779 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f9c5c378056be4338c2220ced653fef9 in 19ms, sequenceid=6, compaction requested=false at 1676300642784 (+5 ms)Writing region close event to WAL at 1676300642785 (+1 ms)Running coprocessor post-close hooks at 1676300642788 (+3 ms)Closed at 1676300642788 2023-02-13 15:04:02,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676300640383.f9c5c378056be4338c2220ced653fef9. 2023-02-13 15:04:02,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/.tmp/rep_barrier/a3cd4c61f4ce4c37820f85e8f2433853 2023-02-13 15:04:02,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3cd4c61f4ce4c37820f85e8f2433853 2023-02-13 15:04:02,804 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/.tmp/table/038f2efbb7c6479dab67726648d39037 2023-02-13 15:04:02,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 038f2efbb7c6479dab67726648d39037 2023-02-13 15:04:02,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/.tmp/info/f987d5bc494e4001bd9f2ecc7d9498af as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/info/f987d5bc494e4001bd9f2ecc7d9498af 2023-02-13 15:04:02,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f987d5bc494e4001bd9f2ecc7d9498af 2023-02-13 15:04:02,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/info/f987d5bc494e4001bd9f2ecc7d9498af, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 15:04:02,811 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/.tmp/rep_barrier/a3cd4c61f4ce4c37820f85e8f2433853 as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/rep_barrier/a3cd4c61f4ce4c37820f85e8f2433853 2023-02-13 15:04:02,815 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3cd4c61f4ce4c37820f85e8f2433853 2023-02-13 15:04:02,815 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/rep_barrier/a3cd4c61f4ce4c37820f85e8f2433853, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 15:04:02,816 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/.tmp/table/038f2efbb7c6479dab67726648d39037 as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/table/038f2efbb7c6479dab67726648d39037 2023-02-13 15:04:02,818 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:02,821 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:02,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 038f2efbb7c6479dab67726648d39037 2023-02-13 15:04:02,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/table/038f2efbb7c6479dab67726648d39037, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 15:04:02,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4316, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=21, compaction requested=false 2023-02-13 15:04:02,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 15:04:02,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:04:02,834 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:02,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300642766Running coprocessor pre-close hooks at 1676300642766Disabling compacts and flushes for region at 1676300642766Disabling writes for close at 1676300642766Obtaining lock to block concurrent updates at 1676300642766Preparing flush snapshotting stores in 1588230740 at 1676300642766Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4316, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676300642766Flushing stores of hbase:meta,,1.1588230740 at 1676300642766Flushing 1588230740/info: creating writer at 1676300642767 (+1 ms)Flushing 1588230740/info: appending metadata at 1676300642769 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676300642769Flushing 1588230740/rep_barrier: creating writer at 1676300642782 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676300642785 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676300642785Flushing 1588230740/table: creating writer at 1676300642797 (+12 ms)Flushing 1588230740/table: appending metadata at 1676300642799 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676300642799Flushing 1588230740/info: reopening flushed file at 1676300642808 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676300642812 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676300642817 (+5 ms)Finished flush of dataSize ~4.21 KB/4316, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=21, compaction requested=false at 1676300642825 (+8 ms)Writing region close event to WAL at 1676300642831 (+6 ms)Running coprocessor post-close hooks at 1676300642834 (+3 ms)Closed at 1676300642834 2023-02-13 15:04:02,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:02,962 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:02,962 INFO [RS:1;jenkins-hbase20:44817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44817,1676300639847; zookeeper connection closed. 2023-02-13 15:04:02,962 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76edbb7c rejected from java.util.concurrent.ThreadPoolExecutor@21504c4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:02,962 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76adeb0f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76adeb0f 2023-02-13 15:04:02,962 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:44817-0x1015c5d9fbd0002, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:02,962 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47b5de72 rejected from java.util.concurrent.ThreadPoolExecutor@21504c4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:02,966 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,38669,1676300639815; all regions closed. 2023-02-13 15:04:02,969 DEBUG [RS:0;jenkins-hbase20:38669] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/oldWALs 2023-02-13 15:04:02,969 INFO [RS:0;jenkins-hbase20:38669] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38669%2C1676300639815.meta:.meta(num 1676300640336) 2023-02-13 15:04:02,972 DEBUG [RS:0;jenkins-hbase20:38669] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/oldWALs 2023-02-13 15:04:02,972 INFO [RS:0;jenkins-hbase20:38669] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38669%2C1676300639815:(num 1676300640727) 2023-02-13 15:04:02,972 DEBUG [RS:0;jenkins-hbase20:38669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:02,972 INFO [RS:0;jenkins-hbase20:38669] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:02,972 INFO [RS:0;jenkins-hbase20:38669] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 15:04:02,972 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:02,973 INFO [RS:0;jenkins-hbase20:38669] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38669 2023-02-13 15:04:02,974 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38669,1676300639815 2023-02-13 15:04:02,974 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:02,974 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55b59a2e rejected from java.util.concurrent.ThreadPoolExecutor@518a0440[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:02,975 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38669,1676300639815] 2023-02-13 15:04:02,975 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38669,1676300639815; numProcessing=2 2023-02-13 15:04:02,975 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38669,1676300639815 already deleted, retry=false 2023-02-13 15:04:02,975 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38669,1676300639815 expired; onlineServers=0 2023-02-13 15:04:02,975 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,39335,1676300639778' ***** 2023-02-13 15:04:02,976 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 15:04:02,976 DEBUG [M:0;jenkins-hbase20:39335] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d369dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:02,976 INFO [M:0;jenkins-hbase20:39335] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,39335,1676300639778 2023-02-13 15:04:02,976 INFO [M:0;jenkins-hbase20:39335] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,39335,1676300639778; all regions closed. 2023-02-13 15:04:02,976 DEBUG [M:0;jenkins-hbase20:39335] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:02,977 DEBUG [M:0;jenkins-hbase20:39335] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 15:04:02,977 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 15:04:02,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300639986] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300639986,5,FailOnTimeoutGroup] 2023-02-13 15:04:02,977 DEBUG [M:0;jenkins-hbase20:39335] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 15:04:02,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300639986] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300639986,5,FailOnTimeoutGroup] 2023-02-13 15:04:02,977 INFO [M:0;jenkins-hbase20:39335] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 15:04:02,978 INFO [M:0;jenkins-hbase20:39335] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 15:04:02,978 INFO [M:0;jenkins-hbase20:39335] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 15:04:02,978 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:02,978 DEBUG [M:0;jenkins-hbase20:39335] master.HMaster(1502): Stopping service threads 2023-02-13 15:04:02,978 INFO [M:0;jenkins-hbase20:39335] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 15:04:02,978 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:02,978 ERROR [M:0;jenkins-hbase20:39335] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 15:04:02,979 INFO [M:0;jenkins-hbase20:39335] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 15:04:02,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:02,979 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 15:04:02,979 DEBUG [M:0;jenkins-hbase20:39335] zookeeper.ZKUtil(398): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 15:04:02,979 WARN [M:0;jenkins-hbase20:39335] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 15:04:02,979 INFO [M:0;jenkins-hbase20:39335] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 15:04:02,979 INFO [M:0;jenkins-hbase20:39335] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 15:04:02,979 DEBUG [M:0;jenkins-hbase20:39335] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:04:02,979 INFO [M:0;jenkins-hbase20:39335] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:02,980 DEBUG [M:0;jenkins-hbase20:39335] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:02,980 DEBUG [M:0;jenkins-hbase20:39335] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:04:02,980 DEBUG [M:0;jenkins-hbase20:39335] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:02,980 INFO [M:0;jenkins-hbase20:39335] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.19 KB heapSize=67.13 KB 2023-02-13 15:04:02,989 INFO [M:0;jenkins-hbase20:39335] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.19 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2eda5e4fd0c748719f2f400fbe7bdf14 2023-02-13 15:04:02,993 DEBUG [M:0;jenkins-hbase20:39335] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2eda5e4fd0c748719f2f400fbe7bdf14 as hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2eda5e4fd0c748719f2f400fbe7bdf14 2023-02-13 15:04:02,997 INFO [M:0;jenkins-hbase20:39335] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46331/user/jenkins/test-data/5d9b2b4e-2138-602d-81ab-e22a16fbbc4e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2eda5e4fd0c748719f2f400fbe7bdf14, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 15:04:02,998 INFO [M:0;jenkins-hbase20:39335] regionserver.HRegion(2947): Finished flush of dataSize ~56.19 KB/57540, heapSize ~67.11 KB/68720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-13 15:04:02,999 INFO [M:0;jenkins-hbase20:39335] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:03,000 DEBUG [M:0;jenkins-hbase20:39335] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300642979Disabling compacts and flushes for region at 1676300642979Disabling writes for close at 1676300642980 (+1 ms)Obtaining lock to block concurrent updates at 1676300642980Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676300642980Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57540, getHeapSize=68720, getOffHeapSize=0, getCellsCount=145 at 1676300642980Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676300642981 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676300642981Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676300642983 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676300642983Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676300642993 (+10 ms)Finished flush of dataSize ~56.19 KB/57540, heapSize ~67.11 KB/68720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676300642998 (+5 ms)Writing region close event to WAL at 1676300642999 (+1 ms)Closed at 1676300642999 2023-02-13 15:04:03,002 INFO [M:0;jenkins-hbase20:39335] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 15:04:03,002 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:03,003 INFO [M:0;jenkins-hbase20:39335] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39335 2023-02-13 15:04:03,005 DEBUG [M:0;jenkins-hbase20:39335] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,39335,1676300639778 already deleted, retry=false 2023-02-13 15:04:03,366 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:03,366 INFO [M:0;jenkins-hbase20:39335] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,39335,1676300639778; zookeeper connection closed. 2023-02-13 15:04:03,366 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12d5436f rejected from java.util.concurrent.ThreadPoolExecutor@16eac5ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:03,368 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): master:39335-0x1015c5d9fbd0000, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:03,368 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a8763f2 rejected from java.util.concurrent.ThreadPoolExecutor@16eac5ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:03,466 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:03,466 INFO [RS:0;jenkins-hbase20:38669] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,38669,1676300639815; zookeeper connection closed. 2023-02-13 15:04:03,466 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c4b665b rejected from java.util.concurrent.ThreadPoolExecutor@518a0440[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:03,466 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6933a550] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6933a550 2023-02-13 15:04:03,466 DEBUG [Listener at localhost.localdomain/35289-EventThread] zookeeper.ZKWatcher(600): regionserver:38669-0x1015c5d9fbd0001, quorum=127.0.0.1:50569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:03,466 ERROR [Listener at localhost.localdomain/35289-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@247f4bf8 rejected from java.util.concurrent.ThreadPoolExecutor@518a0440[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:03,467 INFO [Listener at localhost.localdomain/35289] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 15:04:03,467 WARN [Listener at localhost.localdomain/35289] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:04:03,470 INFO [Listener at localhost.localdomain/35289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:04:03,574 WARN [BP-1648515281-148.251.75.209-1676300639285 heartbeating to localhost.localdomain/127.0.0.1:46331] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:04:03,574 WARN [BP-1648515281-148.251.75.209-1676300639285 heartbeating to localhost.localdomain/127.0.0.1:46331] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1648515281-148.251.75.209-1676300639285 (Datanode Uuid d2b11005-e09f-416e-8104-d1627b523cc1) service to localhost.localdomain/127.0.0.1:46331 2023-02-13 15:04:03,574 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f/dfs/data/data3/current/BP-1648515281-148.251.75.209-1676300639285] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:03,575 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f/dfs/data/data4/current/BP-1648515281-148.251.75.209-1676300639285] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:03,576 WARN [Listener at localhost.localdomain/35289] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:04:03,578 INFO [Listener at localhost.localdomain/35289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:04:03,683 WARN [BP-1648515281-148.251.75.209-1676300639285 heartbeating to localhost.localdomain/127.0.0.1:46331] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:04:03,683 WARN [BP-1648515281-148.251.75.209-1676300639285 heartbeating to localhost.localdomain/127.0.0.1:46331] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1648515281-148.251.75.209-1676300639285 (Datanode Uuid 6c6992d7-ad4f-47d2-85f1-e432849e80c7) service to localhost.localdomain/127.0.0.1:46331 2023-02-13 15:04:03,684 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f/dfs/data/data1/current/BP-1648515281-148.251.75.209-1676300639285] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:03,684 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/cluster_b86467a2-4e72-5692-2a5a-e0f3fe82de9f/dfs/data/data2/current/BP-1648515281-148.251.75.209-1676300639285] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:03,692 INFO [Listener at localhost.localdomain/35289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 15:04:03,803 INFO [Listener at localhost.localdomain/35289] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 15:04:03,819 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 15:04:03,829 INFO [Listener at localhost.localdomain/35289] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 230) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:46331 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:46331 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/35289.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:46331 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost.localdomain:46331 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,39335,1676300639778)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/35289 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:46331 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:46331 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost.localdomain:46331 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=668 (was 641) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 244) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=6892 (was 6958) 2023-02-13 15:04:03,839 INFO [Listener at localhost.localdomain/35289] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=668, MaxFileDescriptor=60000, SystemLoadAverage=248, ProcessCount=164, AvailableMemoryMB=6892 2023-02-13 15:04:03,847 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/hadoop.log.dir so I do NOT create it in target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5 2023-02-13 15:04:03,847 WARN [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 15:04:03,847 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/hadoop.tmp.dir so I do NOT create it in target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5 2023-02-13 15:04:03,847 WARN [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0eaafc-c00b-3bf7-e22a-799e9ecca7ec/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 15:04:03,847 DEBUG [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5 2023-02-13 15:04:03,847 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 15:04:03,847 INFO [Listener at localhost.localdomain/35289] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0, deleteOnExit=true 2023-02-13 15:04:03,847 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/test.cache.data in system properties and HBase conf 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/hadoop.log.dir in system properties and HBase conf 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 15:04:03,848 DEBUG [Listener at localhost.localdomain/35289] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:04:03,848 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/nfs.dump.dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/java.io.tmpdir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 15:04:03,849 INFO [Listener at localhost.localdomain/35289] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 15:04:03,852 WARN [Listener at localhost.localdomain/35289] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:04:03,852 WARN [Listener at localhost.localdomain/35289] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:04:03,871 WARN [Listener at localhost.localdomain/35289] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 15:04:03,941 WARN [Listener at localhost.localdomain/35289] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:04:03,943 INFO [Listener at localhost.localdomain/35289] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:04:03,947 INFO [Listener at localhost.localdomain/35289] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/java.io.tmpdir/Jetty_localhost_localdomain_37413_hdfs____.3s9qyc/webapp 2023-02-13 15:04:03,955 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:04:04,019 INFO [Listener at localhost.localdomain/35289] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:37413 2023-02-13 15:04:04,022 WARN [Listener at localhost.localdomain/35289] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:04:04,022 WARN [Listener at localhost.localdomain/35289] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:04:04,049 WARN [Listener at localhost.localdomain/35783] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:04:04,065 WARN [Listener at localhost.localdomain/35783] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:04:04,067 WARN [Listener at localhost.localdomain/35783] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:04:04,068 INFO [Listener at localhost.localdomain/35783] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:04:04,072 INFO [Listener at localhost.localdomain/35783] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/java.io.tmpdir/Jetty_localhost_43193_datanode____.617ap9/webapp 2023-02-13 15:04:04,144 INFO [Listener at localhost.localdomain/35783] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43193 2023-02-13 15:04:04,154 WARN [Listener at localhost.localdomain/36579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:04:04,167 WARN [Listener at localhost.localdomain/36579] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:04:04,169 WARN [Listener at localhost.localdomain/36579] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:04:04,171 INFO [Listener at localhost.localdomain/36579] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:04:04,178 INFO [Listener at localhost.localdomain/36579] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/java.io.tmpdir/Jetty_localhost_37673_datanode____85wj9x/webapp 2023-02-13 15:04:04,221 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed1b4607e5ff4d55: Processing first storage report for DS-a36e8968-1989-499b-b838-bfe7899653f4 from datanode 0214844c-3c5a-49e5-9a06-b024a588e655 2023-02-13 15:04:04,221 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed1b4607e5ff4d55: from storage DS-a36e8968-1989-499b-b838-bfe7899653f4 node DatanodeRegistration(127.0.0.1:46437, datanodeUuid=0214844c-3c5a-49e5-9a06-b024a588e655, infoPort=41459, infoSecurePort=0, ipcPort=36579, storageInfo=lv=-57;cid=testClusterID;nsid=98716240;c=1676300643853), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:04,221 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed1b4607e5ff4d55: Processing first storage report for DS-f5c821ad-2eab-43cf-a50b-76c2b820e2bc from datanode 0214844c-3c5a-49e5-9a06-b024a588e655 2023-02-13 15:04:04,221 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed1b4607e5ff4d55: from storage DS-f5c821ad-2eab-43cf-a50b-76c2b820e2bc node DatanodeRegistration(127.0.0.1:46437, datanodeUuid=0214844c-3c5a-49e5-9a06-b024a588e655, infoPort=41459, infoSecurePort=0, ipcPort=36579, storageInfo=lv=-57;cid=testClusterID;nsid=98716240;c=1676300643853), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:04,262 INFO [Listener at localhost.localdomain/36579] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37673 2023-02-13 15:04:04,269 WARN [Listener at localhost.localdomain/39887] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:04:04,353 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf24b53d31b7cb382: Processing first storage report for DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727 from datanode d029afb7-3a10-4903-801d-a336a3728d7f 2023-02-13 15:04:04,353 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf24b53d31b7cb382: from storage DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727 node DatanodeRegistration(127.0.0.1:42981, datanodeUuid=d029afb7-3a10-4903-801d-a336a3728d7f, infoPort=34287, infoSecurePort=0, ipcPort=39887, storageInfo=lv=-57;cid=testClusterID;nsid=98716240;c=1676300643853), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:04,353 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf24b53d31b7cb382: Processing first storage report for DS-781507d6-bdf9-4c32-acb7-722e1b51ea12 from datanode d029afb7-3a10-4903-801d-a336a3728d7f 2023-02-13 15:04:04,353 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf24b53d31b7cb382: from storage DS-781507d6-bdf9-4c32-acb7-722e1b51ea12 node DatanodeRegistration(127.0.0.1:42981, datanodeUuid=d029afb7-3a10-4903-801d-a336a3728d7f, infoPort=34287, infoSecurePort=0, ipcPort=39887, storageInfo=lv=-57;cid=testClusterID;nsid=98716240;c=1676300643853), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:04,378 DEBUG [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5 2023-02-13 15:04:04,379 INFO [Listener at localhost.localdomain/39887] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0/zookeeper_0, clientPort=53383, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 15:04:04,380 INFO [Listener at localhost.localdomain/39887] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53383 2023-02-13 15:04:04,380 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,381 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,395 INFO [Listener at localhost.localdomain/39887] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d with version=8 2023-02-13 15:04:04,395 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,396 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,397 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:35783/user/jenkins/test-data/3e658a37-a7fb-4509-a1d1-0a08a3de8e3b/hbase-staging 2023-02-13 15:04:04,398 INFO [Listener at localhost.localdomain/39887] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:04:04,399 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,399 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,399 INFO [Listener at localhost.localdomain/39887] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:04:04,399 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,399 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:04:04,399 INFO [Listener at localhost.localdomain/39887] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:04:04,402 INFO [Listener at localhost.localdomain/39887] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36953 2023-02-13 15:04:04,403 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,403 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,404 INFO [Listener at localhost.localdomain/39887] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36953 connecting to ZooKeeper ensemble=127.0.0.1:53383 2023-02-13 15:04:04,409 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:369530x0, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:04:04,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36953-0x1015c5db1ca0000 connected 2023-02-13 15:04:04,424 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:04,424 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:04,425 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:04:04,426 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36953 2023-02-13 15:04:04,427 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36953 2023-02-13 15:04:04,431 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36953 2023-02-13 15:04:04,431 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36953 2023-02-13 15:04:04,431 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36953 2023-02-13 15:04:04,431 INFO [Listener at localhost.localdomain/39887] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d, hbase.cluster.distributed=false 2023-02-13 15:04:04,441 INFO [Listener at localhost.localdomain/39887] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:04:04,441 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,441 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,441 INFO [Listener at localhost.localdomain/39887] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:04:04,441 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,441 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:04:04,441 INFO [Listener at localhost.localdomain/39887] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:04:04,442 INFO [Listener at localhost.localdomain/39887] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42121 2023-02-13 15:04:04,442 INFO [Listener at localhost.localdomain/39887] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:04:04,443 DEBUG [Listener at localhost.localdomain/39887] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:04:04,443 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,443 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,444 INFO [Listener at localhost.localdomain/39887] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42121 connecting to ZooKeeper ensemble=127.0.0.1:53383 2023-02-13 15:04:04,447 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:421210x0, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:04:04,447 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): regionserver:421210x0, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:04,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42121-0x1015c5db1ca0001 connected 2023-02-13 15:04:04,448 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:04,449 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:04:04,455 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42121 2023-02-13 15:04:04,455 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42121 2023-02-13 15:04:04,455 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42121 2023-02-13 15:04:04,455 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42121 2023-02-13 15:04:04,456 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42121 2023-02-13 15:04:04,464 INFO [Listener at localhost.localdomain/39887] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:04:04,464 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,464 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,464 INFO [Listener at localhost.localdomain/39887] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:04:04,464 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:04,465 INFO [Listener at localhost.localdomain/39887] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:04:04,465 INFO [Listener at localhost.localdomain/39887] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:04:04,465 INFO [Listener at localhost.localdomain/39887] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33835 2023-02-13 15:04:04,465 INFO [Listener at localhost.localdomain/39887] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:04:04,466 DEBUG [Listener at localhost.localdomain/39887] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:04:04,466 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,467 INFO [Listener at localhost.localdomain/39887] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,468 INFO [Listener at localhost.localdomain/39887] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33835 connecting to ZooKeeper ensemble=127.0.0.1:53383 2023-02-13 15:04:04,486 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:338350x0, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:04:04,486 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): regionserver:338350x0, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:04,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33835-0x1015c5db1ca0002 connected 2023-02-13 15:04:04,488 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:04,488 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ZKUtil(164): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:04:04,489 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33835 2023-02-13 15:04:04,489 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33835 2023-02-13 15:04:04,495 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33835 2023-02-13 15:04:04,495 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33835 2023-02-13 15:04:04,495 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33835 2023-02-13 15:04:04,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:04,497 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:04:04,498 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:04,499 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:04,499 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:04,499 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:04,499 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:04,501 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:04:04,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:04:04,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,36953,1676300644398 from backup master directory 2023-02-13 15:04:04,502 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:04,502 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:04:04,502 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:04,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:04,514 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/hbase.id with ID: 76b7ed99-11f4-46d9-a336-7ccd9bdae990 2023-02-13 15:04:04,521 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:04,522 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:04,532 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x45474886 to 127.0.0.1:53383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:04,536 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ce477d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:04,536 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:04,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 15:04:04,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:04,538 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store-tmp 2023-02-13 15:04:04,545 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:04,545 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:04:04,545 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:04,545 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:04,545 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:04:04,545 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:04,545 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:04,545 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300644545Disabling compacts and flushes for region at 1676300644545Disabling writes for close at 1676300644545Writing region close event to WAL at 1676300644545Closed at 1676300644545 2023-02-13 15:04:04,546 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/WALs/jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:04,547 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36953%2C1676300644398, suffix=, logDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/WALs/jenkins-hbase20.apache.org,36953,1676300644398, archiveDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/oldWALs, maxLogs=10 2023-02-13 15:04:04,558 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK] 2023-02-13 15:04:04,558 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK] 2023-02-13 15:04:04,559 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/WALs/jenkins-hbase20.apache.org,36953,1676300644398/jenkins-hbase20.apache.org%2C36953%2C1676300644398.1676300644547 2023-02-13 15:04:04,560 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK], DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK]] 2023-02-13 15:04:04,560 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:04,560 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:04,560 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:04,560 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:04,563 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:04,564 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 15:04:04,564 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 15:04:04,565 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:04,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:04,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:04,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:04,570 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:04,571 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74384261, jitterRate=0.10841186344623566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:04:04,571 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676300644560Initializing all the Stores at 1676300644561 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300644561Cleaning up temporary data from old regions at 1676300644566 (+5 ms)Cleaning up detritus from prior splits at 1676300644566Region opened successfully at 1676300644571 (+5 ms) 2023-02-13 15:04:04,575 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 15:04:04,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 15:04:04,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 15:04:04,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 15:04:04,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 15:04:04,577 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 15:04:04,577 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 15:04:04,577 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 15:04:04,578 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 15:04:04,590 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 15:04:04,591 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 15:04:04,591 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 15:04:04,591 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 15:04:04,592 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 15:04:04,596 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:04,596 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 15:04:04,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 15:04:04,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 15:04:04,598 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:04,598 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:04,598 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:04,598 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:04,598 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,36953,1676300644398, sessionid=0x1015c5db1ca0000, setting cluster-up flag (Was=false) 2023-02-13 15:04:04,601 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:04,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 15:04:04,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:04,606 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:04,608 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 15:04:04,608 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:04,609 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.hbase-snapshot/.tmp 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:04,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676300674615 2023-02-13 15:04:04,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 15:04:04,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 15:04:04,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 15:04:04,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 15:04:04,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 15:04:04,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 15:04:04,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,616 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:04:04,616 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 15:04:04,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 15:04:04,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 15:04:04,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 15:04:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 15:04:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 15:04:04,617 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300644617,5,FailOnTimeoutGroup] 2023-02-13 15:04:04,617 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300644617,5,FailOnTimeoutGroup] 2023-02-13 15:04:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 15:04:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,617 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:04,627 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:04,628 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:04,628 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d 2023-02-13 15:04:04,638 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:04,639 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:04:04,640 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/info 2023-02-13 15:04:04,640 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:04:04,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:04,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:04:04,641 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:04,641 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:04:04,642 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:04,642 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:04:04,642 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/table 2023-02-13 15:04:04,643 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:04:04,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:04,643 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740 2023-02-13 15:04:04,643 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740 2023-02-13 15:04:04,645 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:04:04,645 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:04:04,646 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:04,647 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74893341, jitterRate=0.11599774658679962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:04:04,647 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676300644638Initializing all the Stores at 1676300644638Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300644639 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300644639Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300644639Cleaning up temporary data from old regions at 1676300644644 (+5 ms)Cleaning up detritus from prior splits at 1676300644644Region opened successfully at 1676300644647 (+3 ms) 2023-02-13 15:04:04,647 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:04:04,647 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:04:04,647 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:04:04,647 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:04:04,647 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:04:04,647 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:04,647 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300644647Disabling compacts and flushes for region at 1676300644647Disabling writes for close at 1676300644647Writing region close event to WAL at 1676300644647Closed at 1676300644647 2023-02-13 15:04:04,648 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:04:04,648 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 15:04:04,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 15:04:04,649 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 15:04:04,650 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 15:04:04,698 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(952): ClusterId : 76b7ed99-11f4-46d9-a336-7ccd9bdae990 2023-02-13 15:04:04,698 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(952): ClusterId : 76b7ed99-11f4-46d9-a336-7ccd9bdae990 2023-02-13 15:04:04,698 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:04:04,698 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:04:04,699 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:04:04,699 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:04:04,699 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:04:04,699 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:04:04,700 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:04:04,701 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:04:04,702 DEBUG [RS:1;jenkins-hbase20:33835] zookeeper.ReadOnlyZKClient(139): Connect 0x689b56b5 to 127.0.0.1:53383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:04,702 DEBUG [RS:0;jenkins-hbase20:42121] zookeeper.ReadOnlyZKClient(139): Connect 0x3e6b77b4 to 127.0.0.1:53383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:04,704 DEBUG [RS:0;jenkins-hbase20:42121] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30ac9e09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:04,704 DEBUG [RS:1;jenkins-hbase20:33835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@665ca5d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:04,704 DEBUG [RS:0;jenkins-hbase20:42121] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34931cc4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:04,704 DEBUG [RS:1;jenkins-hbase20:33835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62633dc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:04,710 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:33835 2023-02-13 15:04:04,710 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:42121 2023-02-13 15:04:04,711 INFO [RS:1;jenkins-hbase20:33835] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:04:04,711 INFO [RS:1;jenkins-hbase20:33835] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:04:04,711 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:04:04,711 INFO [RS:0;jenkins-hbase20:42121] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:04:04,711 INFO [RS:0;jenkins-hbase20:42121] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:04:04,711 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:04:04,711 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,36953,1676300644398 with isa=jenkins-hbase20.apache.org/148.251.75.209:42121, startcode=1676300644440 2023-02-13 15:04:04,711 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,36953,1676300644398 with isa=jenkins-hbase20.apache.org/148.251.75.209:33835, startcode=1676300644464 2023-02-13 15:04:04,712 DEBUG [RS:1;jenkins-hbase20:33835] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:04:04,712 DEBUG [RS:0;jenkins-hbase20:42121] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:04:04,713 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57687, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:04:04,713 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51367, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:04:04,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36953] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,715 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:04,716 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d 2023-02-13 15:04:04,716 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:35783 2023-02-13 15:04:04,716 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:04:04,716 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d 2023-02-13 15:04:04,716 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:35783 2023-02-13 15:04:04,716 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:04:04,717 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:04,719 DEBUG [RS:0;jenkins-hbase20:42121] zookeeper.ZKUtil(162): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:04,719 WARN [RS:0;jenkins-hbase20:42121] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:04,719 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,33835,1676300644464] 2023-02-13 15:04:04,719 INFO [RS:0;jenkins-hbase20:42121] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:04,719 DEBUG [RS:1;jenkins-hbase20:33835] zookeeper.ZKUtil(162): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,719 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42121,1676300644440] 2023-02-13 15:04:04,719 WARN [RS:1;jenkins-hbase20:33835] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:04,719 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:04,719 INFO [RS:1;jenkins-hbase20:33835] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:04,719 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,724 DEBUG [RS:1;jenkins-hbase20:33835] zookeeper.ZKUtil(162): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,724 DEBUG [RS:0;jenkins-hbase20:42121] zookeeper.ZKUtil(162): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,724 DEBUG [RS:1;jenkins-hbase20:33835] zookeeper.ZKUtil(162): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:04,725 DEBUG [RS:0;jenkins-hbase20:42121] zookeeper.ZKUtil(162): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:04,725 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:04:04,725 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:04:04,725 INFO [RS:0;jenkins-hbase20:42121] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:04:04,725 INFO [RS:1;jenkins-hbase20:33835] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:04:04,726 INFO [RS:0;jenkins-hbase20:42121] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:04:04,727 INFO [RS:0;jenkins-hbase20:42121] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:04:04,727 INFO [RS:0;jenkins-hbase20:42121] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,727 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:04:04,728 INFO [RS:1;jenkins-hbase20:33835] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:04:04,728 INFO [RS:1;jenkins-hbase20:33835] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:04:04,728 INFO [RS:1;jenkins-hbase20:33835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,729 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:04:04,729 INFO [RS:0;jenkins-hbase20:42121] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,730 INFO [RS:1;jenkins-hbase20:33835] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,730 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:0;jenkins-hbase20:42121] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,731 DEBUG [RS:1;jenkins-hbase20:33835] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:04,733 INFO [RS:0;jenkins-hbase20:42121] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,734 INFO [RS:0;jenkins-hbase20:42121] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,734 INFO [RS:0;jenkins-hbase20:42121] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,735 INFO [RS:1;jenkins-hbase20:33835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,735 INFO [RS:1;jenkins-hbase20:33835] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,735 INFO [RS:1;jenkins-hbase20:33835] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,747 INFO [RS:0;jenkins-hbase20:42121] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:04:04,747 INFO [RS:0;jenkins-hbase20:42121] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42121,1676300644440-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,749 INFO [RS:1;jenkins-hbase20:33835] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:04:04,749 INFO [RS:1;jenkins-hbase20:33835] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33835,1676300644464-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:04,758 INFO [RS:0;jenkins-hbase20:42121] regionserver.Replication(203): jenkins-hbase20.apache.org,42121,1676300644440 started 2023-02-13 15:04:04,758 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,42121,1676300644440, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42121, sessionid=0x1015c5db1ca0001 2023-02-13 15:04:04,758 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:04:04,758 DEBUG [RS:0;jenkins-hbase20:42121] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:04,758 DEBUG [RS:0;jenkins-hbase20:42121] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42121,1676300644440' 2023-02-13 15:04:04,758 DEBUG [RS:0;jenkins-hbase20:42121] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:04,759 DEBUG [RS:0;jenkins-hbase20:42121] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:04,759 INFO [RS:1;jenkins-hbase20:33835] regionserver.Replication(203): jenkins-hbase20.apache.org,33835,1676300644464 started 2023-02-13 15:04:04,759 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,33835,1676300644464, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:33835, sessionid=0x1015c5db1ca0002 2023-02-13 15:04:04,759 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:04:04,759 DEBUG [RS:1;jenkins-hbase20:33835] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,759 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:04:04,759 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:04:04,759 DEBUG [RS:1;jenkins-hbase20:33835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33835,1676300644464' 2023-02-13 15:04:04,759 DEBUG [RS:1;jenkins-hbase20:33835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:04,759 DEBUG [RS:0;jenkins-hbase20:42121] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:04,759 DEBUG [RS:0;jenkins-hbase20:42121] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42121,1676300644440' 2023-02-13 15:04:04,759 DEBUG [RS:0;jenkins-hbase20:42121] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:04,760 DEBUG [RS:0;jenkins-hbase20:42121] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33835,1676300644464' 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:04,760 DEBUG [RS:0;jenkins-hbase20:42121] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:04:04,760 INFO [RS:0;jenkins-hbase20:42121] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:04:04,760 INFO [RS:0;jenkins-hbase20:42121] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:04,760 DEBUG [RS:1;jenkins-hbase20:33835] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:04:04,760 INFO [RS:1;jenkins-hbase20:33835] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:04:04,760 INFO [RS:1;jenkins-hbase20:33835] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:04:04,801 DEBUG [jenkins-hbase20:36953] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 15:04:04,801 DEBUG [jenkins-hbase20:36953] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:04,802 DEBUG [jenkins-hbase20:36953] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:04,802 DEBUG [jenkins-hbase20:36953] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:04,803 DEBUG [jenkins-hbase20:36953] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:04,803 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,33835,1676300644464, state=OPENING 2023-02-13 15:04:04,804 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 15:04:04,804 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:04,805 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:04:04,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,33835,1676300644464}] 2023-02-13 15:04:04,959 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:04,960 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:04:04,961 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54812, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:04:04,965 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 15:04:04,965 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:04,966 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33835%2C1676300644464.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,33835,1676300644464, archiveDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/oldWALs, maxLogs=32 2023-02-13 15:04:04,977 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK] 2023-02-13 15:04:04,977 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK] 2023-02-13 15:04:04,978 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,33835,1676300644464/jenkins-hbase20.apache.org%2C33835%2C1676300644464.meta.1676300644967.meta 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK], DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK]] 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 15:04:04,979 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 15:04:04,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 15:04:04,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:04:04,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/info 2023-02-13 15:04:04,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/info 2023-02-13 15:04:04,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:04:04,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:04,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:04:04,982 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:04,982 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:04,982 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:04:04,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:04,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:04:04,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/table 2023-02-13 15:04:04,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/table 2023-02-13 15:04:04,984 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:04:04,984 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:04,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740 2023-02-13 15:04:04,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740 2023-02-13 15:04:04,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:04:04,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:04:04,988 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61263749, jitterRate=-0.08709900081157684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:04:04,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676300644979Writing region info on filesystem at 1676300644979Initializing all the Stores at 1676300644980 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300644980Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300644980Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300644980Cleaning up temporary data from old regions at 1676300644986 (+6 ms)Cleaning up detritus from prior splits at 1676300644986Running coprocessor post-open hooks at 1676300644988 (+2 ms)Region opened successfully at 1676300644988 2023-02-13 15:04:04,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676300644959 2023-02-13 15:04:04,993 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 15:04:04,993 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 15:04:04,994 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,33835,1676300644464, state=OPEN 2023-02-13 15:04:04,994 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 15:04:04,994 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:04:04,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 15:04:04,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,33835,1676300644464 in 189 msec 2023-02-13 15:04:04,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 15:04:04,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 348 msec 2023-02-13 15:04:04,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 388 msec 2023-02-13 15:04:04,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676300644498, completionTime=-1 2023-02-13 15:04:04,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 15:04:04,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 15:04:05,001 DEBUG [hconnection-0x3717783b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:05,002 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:05,003 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 15:04:05,003 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676300705003 2023-02-13 15:04:05,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676300765004 2023-02-13 15:04:05,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-13 15:04:05,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36953,1676300644398-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:05,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36953,1676300644398-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:05,013 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36953,1676300644398-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:05,013 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:36953, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:05,013 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:05,013 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 15:04:05,013 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:05,014 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 15:04:05,015 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 15:04:05,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:04:05,016 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:04:05,017 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,018 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227 empty. 2023-02-13 15:04:05,018 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,018 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 15:04:05,029 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:05,030 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8e8150c8c4bf6ee62eb0627b270f0227, NAME => 'hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp 2023-02-13 15:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8e8150c8c4bf6ee62eb0627b270f0227, disabling compactions & flushes 2023-02-13 15:04:05,041 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. after waiting 0 ms 2023-02-13 15:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:05,041 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8e8150c8c4bf6ee62eb0627b270f0227: Waiting for close lock at 1676300645041Disabling compacts and flushes for region at 1676300645041Disabling writes for close at 1676300645041Writing region close event to WAL at 1676300645041Closed at 1676300645041 2023-02-13 15:04:05,043 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:04:05,044 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300645044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300645044"}]},"ts":"1676300645044"} 2023-02-13 15:04:05,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:04:05,046 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:04:05,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300645046"}]},"ts":"1676300645046"} 2023-02-13 15:04:05,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 15:04:05,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:05,049 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:05,049 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:05,049 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:05,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8e8150c8c4bf6ee62eb0627b270f0227, ASSIGN}] 2023-02-13 15:04:05,052 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8e8150c8c4bf6ee62eb0627b270f0227, ASSIGN 2023-02-13 15:04:05,053 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8e8150c8c4bf6ee62eb0627b270f0227, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42121,1676300644440; forceNewPlan=false, retain=false 2023-02-13 15:04:05,203 INFO [jenkins-hbase20:36953] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:04:05,204 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8e8150c8c4bf6ee62eb0627b270f0227, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:05,204 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300645204"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300645204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300645204"}]},"ts":"1676300645204"} 2023-02-13 15:04:05,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8e8150c8c4bf6ee62eb0627b270f0227, server=jenkins-hbase20.apache.org,42121,1676300644440}] 2023-02-13 15:04:05,358 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:05,358 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:04:05,359 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51476, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:04:05,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:05,364 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42121%2C1676300644440, suffix=, logDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,42121,1676300644440, archiveDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/oldWALs, maxLogs=32 2023-02-13 15:04:05,376 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK] 2023-02-13 15:04:05,376 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK] 2023-02-13 15:04:05,377 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,42121,1676300644440/jenkins-hbase20.apache.org%2C42121%2C1676300644440.1676300645364 2023-02-13 15:04:05,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK], DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK]] 2023-02-13 15:04:05,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e8150c8c4bf6ee62eb0627b270f0227, NAME => 'hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:05,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:05,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,378 INFO [StoreOpener-8e8150c8c4bf6ee62eb0627b270f0227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,379 DEBUG [StoreOpener-8e8150c8c4bf6ee62eb0627b270f0227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/info 2023-02-13 15:04:05,379 DEBUG [StoreOpener-8e8150c8c4bf6ee62eb0627b270f0227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/info 2023-02-13 15:04:05,380 INFO [StoreOpener-8e8150c8c4bf6ee62eb0627b270f0227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e8150c8c4bf6ee62eb0627b270f0227 columnFamilyName info 2023-02-13 15:04:05,380 INFO [StoreOpener-8e8150c8c4bf6ee62eb0627b270f0227-1] regionserver.HStore(310): Store=8e8150c8c4bf6ee62eb0627b270f0227/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:05,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,383 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:05,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:05,384 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8e8150c8c4bf6ee62eb0627b270f0227; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71270300, jitterRate=0.062010228633880615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:04:05,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8e8150c8c4bf6ee62eb0627b270f0227: Running coprocessor pre-open hook at 1676300645378Writing region info on filesystem at 1676300645378Initializing all the Stores at 1676300645378Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300645378Cleaning up temporary data from old regions at 1676300645381 (+3 ms)Cleaning up detritus from prior splits at 1676300645382 (+1 ms)Running coprocessor post-open hooks at 1676300645384 (+2 ms)Region opened successfully at 1676300645384 2023-02-13 15:04:05,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227., pid=6, masterSystemTime=1676300645358 2023-02-13 15:04:05,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:05,389 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:05,389 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8e8150c8c4bf6ee62eb0627b270f0227, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:05,389 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300645389"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300645389"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300645389"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300645389"}]},"ts":"1676300645389"} 2023-02-13 15:04:05,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 15:04:05,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8e8150c8c4bf6ee62eb0627b270f0227, server=jenkins-hbase20.apache.org,42121,1676300644440 in 185 msec 2023-02-13 15:04:05,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 15:04:05,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8e8150c8c4bf6ee62eb0627b270f0227, ASSIGN in 342 msec 2023-02-13 15:04:05,393 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:04:05,393 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300645393"}]},"ts":"1676300645393"} 2023-02-13 15:04:05,394 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 15:04:05,396 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:04:05,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-13 15:04:05,415 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 15:04:05,416 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:05,416 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:05,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:05,419 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51482, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:05,420 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 15:04:05,427 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:05,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-13 15:04:05,431 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 15:04:05,437 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:05,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-13 15:04:05,448 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 15:04:05,449 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 15:04:05,449 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.947sec 2023-02-13 15:04:05,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 15:04:05,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 15:04:05,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 15:04:05,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36953,1676300644398-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 15:04:05,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36953,1676300644398-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 15:04:05,451 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 15:04:05,498 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ReadOnlyZKClient(139): Connect 0x2744ec49 to 127.0.0.1:53383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:05,500 DEBUG [Listener at localhost.localdomain/39887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b5e06ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:05,502 DEBUG [hconnection-0x14c39cfd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:05,504 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54832, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:05,505 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:05,505 DEBUG [Listener at localhost.localdomain/39887] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 15:04:05,507 DEBUG [Listener at localhost.localdomain/39887] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 15:04:05,509 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34838, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 15:04:05,510 INFO [Listener at localhost.localdomain/39887] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:05,510 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:05,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:04:05,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 148.251.75.209:34838 deadline: 1676300705510, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:05,511 INFO [Listener at localhost.localdomain/39887] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 15:04:05,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:05,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:05,515 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:04:05,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-13 15:04:05,516 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:04:05,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:05,517 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80 empty. 2023-02-13 15:04:05,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,518 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 15:04:05,528 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:05,529 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 509cf1e0a6d844e8eca69ff880cb5c80, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp 2023-02-13 15:04:05,534 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:05,535 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 509cf1e0a6d844e8eca69ff880cb5c80, disabling compactions & flushes 2023-02-13 15:04:05,535 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:05,535 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:05,535 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. after waiting 0 ms 2023-02-13 15:04:05,535 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:05,535 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:05,535 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 509cf1e0a6d844e8eca69ff880cb5c80: Waiting for close lock at 1676300645535Disabling compacts and flushes for region at 1676300645535Disabling writes for close at 1676300645535Writing region close event to WAL at 1676300645535Closed at 1676300645535 2023-02-13 15:04:05,536 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:04:05,537 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676300645537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300645537"}]},"ts":"1676300645537"} 2023-02-13 15:04:05,538 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:04:05,539 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:04:05,539 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300645539"}]},"ts":"1676300645539"} 2023-02-13 15:04:05,540 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-13 15:04:05,542 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:05,542 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:05,543 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:05,543 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:05,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=509cf1e0a6d844e8eca69ff880cb5c80, ASSIGN}] 2023-02-13 15:04:05,545 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=509cf1e0a6d844e8eca69ff880cb5c80, ASSIGN 2023-02-13 15:04:05,545 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=509cf1e0a6d844e8eca69ff880cb5c80, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33835,1676300644464; forceNewPlan=false, retain=false 2023-02-13 15:04:05,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:05,695 INFO [jenkins-hbase20:36953] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:04:05,696 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=509cf1e0a6d844e8eca69ff880cb5c80, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:05,696 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676300645696"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300645696"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300645696"}]},"ts":"1676300645696"} 2023-02-13 15:04:05,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 509cf1e0a6d844e8eca69ff880cb5c80, server=jenkins-hbase20.apache.org,33835,1676300644464}] 2023-02-13 15:04:05,762 INFO [RS:1;jenkins-hbase20:33835] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33835%2C1676300644464, suffix=, logDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,33835,1676300644464, archiveDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/oldWALs, maxLogs=32 2023-02-13 15:04:05,772 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK] 2023-02-13 15:04:05,772 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK] 2023-02-13 15:04:05,774 INFO [RS:1;jenkins-hbase20:33835] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/WALs/jenkins-hbase20.apache.org,33835,1676300644464/jenkins-hbase20.apache.org%2C33835%2C1676300644464.1676300645762 2023-02-13 15:04:05,774 DEBUG [RS:1;jenkins-hbase20:33835] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46437,DS-a36e8968-1989-499b-b838-bfe7899653f4,DISK], DatanodeInfoWithStorage[127.0.0.1:42981,DS-d82f7f0d-bc07-43ff-9073-0e15aab7f727,DISK]] 2023-02-13 15:04:05,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:05,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:05,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 509cf1e0a6d844e8eca69ff880cb5c80, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:05,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:05,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,854 INFO [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,855 DEBUG [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1 2023-02-13 15:04:05,855 DEBUG [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1 2023-02-13 15:04:05,855 INFO [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 509cf1e0a6d844e8eca69ff880cb5c80 columnFamilyName f1 2023-02-13 15:04:05,856 INFO [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] regionserver.HStore(310): Store=509cf1e0a6d844e8eca69ff880cb5c80/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:05,856 INFO [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,857 DEBUG [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2 2023-02-13 15:04:05,857 DEBUG [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2 2023-02-13 15:04:05,857 INFO [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 509cf1e0a6d844e8eca69ff880cb5c80 columnFamilyName f2 2023-02-13 15:04:05,858 INFO [StoreOpener-509cf1e0a6d844e8eca69ff880cb5c80-1] regionserver.HStore(310): Store=509cf1e0a6d844e8eca69ff880cb5c80/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:05,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:04:05,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:05,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:05,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 509cf1e0a6d844e8eca69ff880cb5c80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60612346, jitterRate=-0.09680566191673279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:04:05,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 509cf1e0a6d844e8eca69ff880cb5c80: Running coprocessor pre-open hook at 1676300645852Writing region info on filesystem at 1676300645852Initializing all the Stores at 1676300645853 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300645853Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300645853Cleaning up temporary data from old regions at 1676300645859 (+6 ms)Cleaning up detritus from prior splits at 1676300645859Running coprocessor post-open hooks at 1676300645862 (+3 ms)Region opened successfully at 1676300645862 2023-02-13 15:04:05,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80., pid=12, masterSystemTime=1676300645849 2023-02-13 15:04:05,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:05,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:05,864 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=509cf1e0a6d844e8eca69ff880cb5c80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:05,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676300645864"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300645864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300645864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300645864"}]},"ts":"1676300645864"} 2023-02-13 15:04:05,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 15:04:05,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 509cf1e0a6d844e8eca69ff880cb5c80, server=jenkins-hbase20.apache.org,33835,1676300644464 in 169 msec 2023-02-13 15:04:05,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 15:04:05,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=509cf1e0a6d844e8eca69ff880cb5c80, ASSIGN in 324 msec 2023-02-13 15:04:05,869 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:04:05,869 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300645869"}]},"ts":"1676300645869"} 2023-02-13 15:04:05,870 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-13 15:04:05,872 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:04:05,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 359 msec 2023-02-13 15:04:06,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:06,121 INFO [Listener at localhost.localdomain/39887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-13 15:04:06,122 DEBUG [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-13 15:04:06,122 INFO [Listener at localhost.localdomain/39887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:04:06,123 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-13 15:04:06,123 INFO [Listener at localhost.localdomain/39887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:04:06,124 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-13 15:04:06,124 INFO [Listener at localhost.localdomain/39887] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 15:04:06,149 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33835] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,305 INFO [Listener at localhost.localdomain/39887] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 15:04:06,305 INFO [Listener at localhost.localdomain/39887] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 15:04:06,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 15:04:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676300646306 (current time:1676300646306). 2023-02-13 15:04:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 15:04:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] zookeeper.ReadOnlyZKClient(139): Connect 0x2d69b2c1 to 127.0.0.1:53383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:06,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fbce306, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:06,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:06,311 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d69b2c1 to 127.0.0.1:53383 2023-02-13 15:04:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 15:04:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 15:04:06,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 15:04:06,315 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 15:04:06,316 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676301246316 2023-02-13 15:04:06,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 15:04:06,316 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,317 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 15:04:06,317 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 15:04:06,318 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 15:04:06,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 15:04:06,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-13 15:04:06,327 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 15:04:06,329 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676301246329 2023-02-13 15:04:06,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 15:04:06,346 INFO [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 15:04:06,346 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:06,348 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 15:04:06,348 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 15:04:06,348 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,348 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 15:04:06,349 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:06,349 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:06,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:06,349 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:06,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:06,349 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 15:04:06,349 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 15:04:06,350 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 15:04:06,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 15:04:06,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 15:04:06,351 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 15:04:06,351 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 15:04:06,351 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:06,351 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:06,352 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 15:04:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 15:04:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 15:04:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 15:04:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33835,1676300644464' joining acquired barrier for procedure (foo) in zk 2023-02-13 15:04:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42121,1676300644440' joining acquired barrier for procedure (foo) in zk 2023-02-13 15:04:06,354 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:04:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:06,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33835,1676300644464' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 15:04:06,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc94526[Count = 0] remaining members to acquire global barrier 2023-02-13 15:04:06,355 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 15:04:06,355 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,356 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,356 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,356 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,356 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 15:04:06,356 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:04:06,356 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 15:04:06,356 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 15:04:06,356 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,42121,1676300644440' in zk 2023-02-13 15:04:06,356 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 15:04:06,356 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:04:06,356 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,356 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. started... 2023-02-13 15:04:06,357 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 509cf1e0a6d844e8eca69ff880cb5c80 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 15:04:06,357 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 15:04:06,357 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:06,357 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 15:04:06,370 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff 2023-02-13 15:04:06,386 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f2/e0c05aa7bd26472da16bc2e12c266de1 2023-02-13 15:04:06,389 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff 2023-02-13 15:04:06,393 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:04:06,393 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f2/e0c05aa7bd26472da16bc2e12c266de1 as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/e0c05aa7bd26472da16bc2e12c266de1 2023-02-13 15:04:06,397 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/e0c05aa7bd26472da16bc2e12c266de1, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:04:06,398 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 509cf1e0a6d844e8eca69ff880cb5c80 in 42ms, sequenceid=5, compaction requested=false 2023-02-13 15:04:06,398 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 15:04:06,398 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 509cf1e0a6d844e8eca69ff880cb5c80: 2023-02-13 15:04:06,399 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.' region-info for snapshot=foo 2023-02-13 15:04:06,399 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:04:06,399 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff] hfiles 2023-02-13 15:04:06,399 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff for snapshot=foo 2023-02-13 15:04:06,399 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/e0c05aa7bd26472da16bc2e12c266de1] hfiles 2023-02-13 15:04:06,399 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/e0c05aa7bd26472da16bc2e12c266de1 for snapshot=foo 2023-02-13 15:04:06,404 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. completed. 2023-02-13 15:04:06,404 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,404 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 15:04:06,404 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 15:04:06,404 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,404 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 15:04:06,404 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,33835,1676300644464' in zk 2023-02-13 15:04:06,405 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,405 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 15:04:06,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:06,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:06,405 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:06,406 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 15:04:06,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:06,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:06,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:04:06,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:06,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:04:06,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,33835,1676300644464': 2023-02-13 15:04:06,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33835,1676300644464' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 15:04:06,408 INFO [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 15:04:06,408 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:04:06,408 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:04:06,408 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 15:04:06,408 INFO [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 15:04:06,409 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:06,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:06,409 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:06,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:04:06,410 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:06,411 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 15:04:06,411 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,414 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:06,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 15:04:06,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 15:04:06,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:06,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 15:04:06,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:06,414 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 15:04:06,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.hbase-snapshot/.tmp/foo 2023-02-13 15:04:06,417 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:06,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 15:04:06,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:04:06,419 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 15:04:06,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.hbase-snapshot/foo 2023-02-13 15:04:06,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-13 15:04:06,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.hbase-snapshot/.tmp/foo 2023-02-13 15:04:06,453 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.hbase-snapshot/.tmp/foo 2023-02-13 15:04:06,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676300646316Consolidate snapshot: foo at 1676300646414 (+98 ms)Loading Region manifests for foo at 1676300646414Writing data manifest for foo at 1676300646416 (+2 ms)Verifying snapshot: foo at 1676300646425 (+9 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676300646452 (+27 ms) 2023-02-13 15:04:06,455 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 15:04:06,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 138 msec 2023-02-13 15:04:06,619 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:06,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 15:04:06,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 15:04:06,620 INFO [Listener at localhost.localdomain/39887] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 15:04:06,624 INFO [Listener at localhost.localdomain/39887] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 15:04:06,628 INFO [Listener at localhost.localdomain/39887] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 15:04:06,651 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33835] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,720 INFO [Listener at localhost.localdomain/39887] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 15:04:06,725 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 15:04:06,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,727 INFO [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 15:04:06,727 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:06,728 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-13 15:04:06,728 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-13 15:04:06,728 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,728 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,729 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:06,729 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:06,729 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:06,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:06,729 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,730 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,730 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 15:04:06,730 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:06,730 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 15:04:06,731 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 15:04:06,731 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:06,732 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 15:04:06,732 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 15:04:06,732 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,732 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. started... 2023-02-13 15:04:06,732 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:04:06,732 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 15:04:06,732 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42121,1676300644440' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 15:04:06,732 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 509cf1e0a6d844e8eca69ff880cb5c80 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 15:04:06,733 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,734 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,734 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:06,753 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f1/3c071b008b6041f5bd3b99e0223e29ff 2023-02-13 15:04:06,770 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f2/2340d9113cad462dbfed9465054e6500 2023-02-13 15:04:06,774 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f1/3c071b008b6041f5bd3b99e0223e29ff as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/3c071b008b6041f5bd3b99e0223e29ff 2023-02-13 15:04:06,777 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/3c071b008b6041f5bd3b99e0223e29ff, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:04:06,778 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/.tmp/f2/2340d9113cad462dbfed9465054e6500 as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/2340d9113cad462dbfed9465054e6500 2023-02-13 15:04:06,782 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/2340d9113cad462dbfed9465054e6500, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:04:06,782 INFO [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 509cf1e0a6d844e8eca69ff880cb5c80 in 50ms, sequenceid=9, compaction requested=false 2023-02-13 15:04:06,783 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 509cf1e0a6d844e8eca69ff880cb5c80: 2023-02-13 15:04:06,783 DEBUG [rs(jenkins-hbase20.apache.org,33835,1676300644464)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,783 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 15:04:06,783 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 15:04:06,783 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,783 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 15:04:06,784 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33835,1676300644464' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 15:04:06,785 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,785 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:06,785 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,785 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:06,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33835,1676300644464' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-13 15:04:06,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f6d247[Count = 0] remaining members to acquire global barrier 2023-02-13 15:04:06,786 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-13 15:04:06,786 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,787 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,787 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 15:04:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 15:04:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,33835,1676300644464' in zk 2023-02-13 15:04:06,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,787 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,787 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:04:06,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 15:04:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 15:04:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,42121,1676300644440' in zk 2023-02-13 15:04:06,788 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,788 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 15:04:06,788 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:06,788 DEBUG [member: 'jenkins-hbase20.apache.org,33835,1676300644464' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 15:04:06,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:06,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:06,788 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 15:04:06,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:06,788 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:06,788 DEBUG [member: 'jenkins-hbase20.apache.org,42121,1676300644440' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 15:04:06,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase20.apache.org,33835,1676300644464': 2023-02-13 15:04:06,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33835,1676300644464' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-13 15:04:06,790 INFO [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-13 15:04:06,790 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:04:06,790 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:04:06,790 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,790 INFO [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 15:04:06,791 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,791 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:06,791 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,791 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:06,791 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,792 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:06,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,792 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:06,793 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,793 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,795 DEBUG [(jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:06,795 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:06,795 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 15:04:06,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 15:04:06,796 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:06,796 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-13 15:04:06,796 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 15:04:06,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:06,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:06,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:06,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:06,798 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:06,798 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:06,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:06,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:06,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:06,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:06,896 DEBUG [Listener at localhost.localdomain/39887] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 15:04:06,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 15:04:06,900 INFO [Listener at localhost.localdomain/39887] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676300646306 type: FLUSH version: 2 ttl: 0 2023-02-13 15:04:06,901 DEBUG [Listener at localhost.localdomain/39887] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:35783/user/jenkins/test-data/3e658a37-a7fb-4509-a1d1-0a08a3de8e3b/foo/dc330165-e4f2-46cf-9227-ebcbd7b96286/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,901 INFO [Listener at localhost.localdomain/39887] snapshot.RestoreSnapshotHelper(239): region to add: 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:06,901 INFO [Listener at localhost.localdomain/39887] snapshot.RestoreSnapshotHelper(585): clone region=509cf1e0a6d844e8eca69ff880cb5c80 as 509cf1e0a6d844e8eca69ff880cb5c80 in snapshot foo 2023-02-13 15:04:06,902 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 509cf1e0a6d844e8eca69ff880cb5c80, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35783/user/jenkins/test-data/3e658a37-a7fb-4509-a1d1-0a08a3de8e3b/foo/dc330165-e4f2-46cf-9227-ebcbd7b96286 2023-02-13 15:04:06,907 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:06,908 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bd7d4f3d44cd42f1b4d81c09b18d56ff from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,909 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0c05aa7bd26472da16bc2e12c266de1 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,911 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 509cf1e0a6d844e8eca69ff880cb5c80, disabling compactions & flushes 2023-02-13 15:04:06,911 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,911 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,911 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. after waiting 0 ms 2023-02-13 15:04:06,911 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,911 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:06,911 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 509cf1e0a6d844e8eca69ff880cb5c80: Waiting for close lock at 1676300646911Disabling compacts and flushes for region at 1676300646911Disabling writes for close at 1676300646911Writing region close event to WAL at 1676300646911Closed at 1676300646911 2023-02-13 15:04:06,913 INFO [Listener at localhost.localdomain/39887] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676300646306 type: FLUSH version: 2 ttl: 0 2023-02-13 15:04:06,913 DEBUG [Listener at localhost.localdomain/39887] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:35783/user/jenkins/test-data/3e658a37-a7fb-4509-a1d1-0a08a3de8e3b/foo/dc330165-e4f2-46cf-9227-ebcbd7b96286 2023-02-13 15:04:06,913 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:35783/user/jenkins/test-data/3e658a37-a7fb-4509-a1d1-0a08a3de8e3b/foo/dc330165-e4f2-46cf-9227-ebcbd7b96286 2023-02-13 15:04:06,914 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(699): |-data/ 2023-02-13 15:04:06,914 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(699): |----default/ 2023-02-13 15:04:06,914 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-13 15:04:06,914 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(699): |----------509cf1e0a6d844e8eca69ff880cb5c80/ 2023-02-13 15:04:06,915 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:04:06,915 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:04:06,915 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=509cf1e0a6d844e8eca69ff880cb5c80-bd7d4f3d44cd42f1b4d81c09b18d56ff 2023-02-13 15:04:06,915 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:04:06,916 DEBUG [Listener at localhost.localdomain/39887] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=509cf1e0a6d844e8eca69ff880cb5c80-e0c05aa7bd26472da16bc2e12c266de1 hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/3c071b008b6041f5bd3b99e0223e29ff hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/2340d9113cad462dbfed9465054e6500 hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/e0c05aa7bd26472da16bc2e12c266de1 2023-02-13 15:04:06,921 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-13 15:04:06,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 15:04:06,924 INFO [Listener at localhost.localdomain/39887] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:06,927 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300646927"}]},"ts":"1676300646927"} 2023-02-13 15:04:06,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:06,928 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-13 15:04:06,929 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-13 15:04:06,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=509cf1e0a6d844e8eca69ff880cb5c80, UNASSIGN}] 2023-02-13 15:04:06,930 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=509cf1e0a6d844e8eca69ff880cb5c80, UNASSIGN 2023-02-13 15:04:06,931 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=509cf1e0a6d844e8eca69ff880cb5c80, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:06,931 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676300646930"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300646930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300646930"}]},"ts":"1676300646930"} 2023-02-13 15:04:06,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 509cf1e0a6d844e8eca69ff880cb5c80, server=jenkins-hbase20.apache.org,33835,1676300644464}] 2023-02-13 15:04:07,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:07,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:07,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 509cf1e0a6d844e8eca69ff880cb5c80, disabling compactions & flushes 2023-02-13 15:04:07,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:07,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:07,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. after waiting 0 ms 2023-02-13 15:04:07,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:07,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:04:07,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80. 2023-02-13 15:04:07,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 509cf1e0a6d844e8eca69ff880cb5c80: Waiting for close lock at 1676300647083Running coprocessor pre-close hooks at 1676300647083Disabling compacts and flushes for region at 1676300647083Disabling writes for close at 1676300647084 (+1 ms)Writing region close event to WAL at 1676300647084Running coprocessor post-close hooks at 1676300647087 (+3 ms)Closed at 1676300647087 2023-02-13 15:04:07,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:07,092 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=509cf1e0a6d844e8eca69ff880cb5c80, regionState=CLOSED 2023-02-13 15:04:07,092 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676300647092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300647092"}]},"ts":"1676300647092"} 2023-02-13 15:04:07,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 15:04:07,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 509cf1e0a6d844e8eca69ff880cb5c80, server=jenkins-hbase20.apache.org,33835,1676300644464 in 161 msec 2023-02-13 15:04:07,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 15:04:07,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=509cf1e0a6d844e8eca69ff880cb5c80, UNASSIGN in 164 msec 2023-02-13 15:04:07,096 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300647096"}]},"ts":"1676300647096"} 2023-02-13 15:04:07,097 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-13 15:04:07,098 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-13 15:04:07,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 174 msec 2023-02-13 15:04:07,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:07,231 INFO [Listener at localhost.localdomain/39887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-13 15:04:07,232 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:07,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:07,234 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:07,234 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:07,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:04:07,237 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:07,239 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1, FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2, FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/recovered.edits] 2023-02-13 15:04:07,241 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/3c071b008b6041f5bd3b99e0223e29ff to hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/3c071b008b6041f5bd3b99e0223e29ff 2023-02-13 15:04:07,242 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff to hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f1/bd7d4f3d44cd42f1b4d81c09b18d56ff 2023-02-13 15:04:07,244 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/2340d9113cad462dbfed9465054e6500 to hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/2340d9113cad462dbfed9465054e6500 2023-02-13 15:04:07,245 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/e0c05aa7bd26472da16bc2e12c266de1 to hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/f2/e0c05aa7bd26472da16bc2e12c266de1 2023-02-13 15:04:07,247 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/recovered.edits/12.seqid to hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80/recovered.edits/12.seqid 2023-02-13 15:04:07,248 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/509cf1e0a6d844e8eca69ff880cb5c80 2023-02-13 15:04:07,248 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 15:04:07,249 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:07,251 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-13 15:04:07,252 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-13 15:04:07,256 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:07,256 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-13 15:04:07,256 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300647256"}]},"ts":"9223372036854775807"} 2023-02-13 15:04:07,257 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 15:04:07,257 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 509cf1e0a6d844e8eca69ff880cb5c80, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676300645513.509cf1e0a6d844e8eca69ff880cb5c80.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 15:04:07,257 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-13 15:04:07,257 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676300647257"}]},"ts":"9223372036854775807"} 2023-02-13 15:04:07,258 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-13 15:04:07,260 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 15:04:07,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 28 msec 2023-02-13 15:04:07,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36953] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:04:07,337 INFO [Listener at localhost.localdomain/39887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-13 15:04:07,337 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 15:04:07,337 INFO [Listener at localhost.localdomain/39887] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 15:04:07,338 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2744ec49 to 127.0.0.1:53383 2023-02-13 15:04:07,338 DEBUG [Listener at localhost.localdomain/39887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:07,338 DEBUG [Listener at localhost.localdomain/39887] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 15:04:07,338 DEBUG [Listener at localhost.localdomain/39887] util.JVMClusterUtil(257): Found active master hash=507128760, stopped=false 2023-02-13 15:04:07,338 INFO [Listener at localhost.localdomain/39887] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:07,339 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:07,339 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:07,339 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:07,339 INFO [Listener at localhost.localdomain/39887] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 15:04:07,339 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:07,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:07,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:07,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:07,341 DEBUG [Listener at localhost.localdomain/39887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45474886 to 127.0.0.1:53383 2023-02-13 15:04:07,341 DEBUG [Listener at localhost.localdomain/39887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:07,342 INFO [Listener at localhost.localdomain/39887] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42121,1676300644440' ***** 2023-02-13 15:04:07,342 INFO [Listener at localhost.localdomain/39887] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:04:07,342 INFO [Listener at localhost.localdomain/39887] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33835,1676300644464' ***** 2023-02-13 15:04:07,342 INFO [Listener at localhost.localdomain/39887] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:04:07,342 INFO [RS:0;jenkins-hbase20:42121] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:04:07,342 INFO [RS:0;jenkins-hbase20:42121] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:04:07,342 INFO [RS:0;jenkins-hbase20:42121] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:04:07,342 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(3304): Received CLOSE for 8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:07,342 INFO [RS:1;jenkins-hbase20:33835] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:04:07,342 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:07,342 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:04:07,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8e8150c8c4bf6ee62eb0627b270f0227, disabling compactions & flushes 2023-02-13 15:04:07,342 DEBUG [RS:0;jenkins-hbase20:42121] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e6b77b4 to 127.0.0.1:53383 2023-02-13 15:04:07,342 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:04:07,342 INFO [RS:1;jenkins-hbase20:33835] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:04:07,343 DEBUG [RS:0;jenkins-hbase20:42121] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:07,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:07,344 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:04:07,344 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1479): Online Regions={8e8150c8c4bf6ee62eb0627b270f0227=hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227.} 2023-02-13 15:04:07,344 INFO [RS:1;jenkins-hbase20:33835] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:04:07,344 DEBUG [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1505): Waiting on 8e8150c8c4bf6ee62eb0627b270f0227 2023-02-13 15:04:07,344 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:07,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:07,345 DEBUG [RS:1;jenkins-hbase20:33835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x689b56b5 to 127.0.0.1:53383 2023-02-13 15:04:07,345 DEBUG [RS:1;jenkins-hbase20:33835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:07,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. after waiting 0 ms 2023-02-13 15:04:07,345 INFO [RS:1;jenkins-hbase20:33835] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:04:07,345 INFO [RS:1;jenkins-hbase20:33835] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:04:07,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:07,345 INFO [RS:1;jenkins-hbase20:33835] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:04:07,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 8e8150c8c4bf6ee62eb0627b270f0227 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 15:04:07,345 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 15:04:07,345 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 15:04:07,345 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 15:04:07,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:04:07,345 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 15:04:07,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:04:07,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:04:07,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:04:07,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:04:07,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.47 KB heapSize=7.87 KB 2023-02-13 15:04:07,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/.tmp/info/076a31c5379240e89efe44d0c7d26531 2023-02-13 15:04:07,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/.tmp/info/af208fee226045f89b53acd5bbde725f 2023-02-13 15:04:07,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 076a31c5379240e89efe44d0c7d26531 2023-02-13 15:04:07,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/.tmp/info/af208fee226045f89b53acd5bbde725f as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/info/af208fee226045f89b53acd5bbde725f 2023-02-13 15:04:07,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/info/af208fee226045f89b53acd5bbde725f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 15:04:07,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8e8150c8c4bf6ee62eb0627b270f0227 in 22ms, sequenceid=6, compaction requested=false 2023-02-13 15:04:07,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/namespace/8e8150c8c4bf6ee62eb0627b270f0227/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 15:04:07,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:07,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8e8150c8c4bf6ee62eb0627b270f0227: Waiting for close lock at 1676300647342Running coprocessor pre-close hooks at 1676300647342Disabling compacts and flushes for region at 1676300647342Disabling writes for close at 1676300647345 (+3 ms)Obtaining lock to block concurrent updates at 1676300647345Preparing flush snapshotting stores in 8e8150c8c4bf6ee62eb0627b270f0227 at 1676300647345Finished memstore snapshotting hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676300647345Flushing stores of hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. at 1676300647346 (+1 ms)Flushing 8e8150c8c4bf6ee62eb0627b270f0227/info: creating writer at 1676300647346Flushing 8e8150c8c4bf6ee62eb0627b270f0227/info: appending metadata at 1676300647347 (+1 ms)Flushing 8e8150c8c4bf6ee62eb0627b270f0227/info: closing flushed file at 1676300647347Flushing 8e8150c8c4bf6ee62eb0627b270f0227/info: reopening flushed file at 1676300647363 (+16 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8e8150c8c4bf6ee62eb0627b270f0227 in 22ms, sequenceid=6, compaction requested=false at 1676300647367 (+4 ms)Writing region close event to WAL at 1676300647368 (+1 ms)Running coprocessor post-close hooks at 1676300647373 (+5 ms)Closed at 1676300647373 2023-02-13 15:04:07,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676300645013.8e8150c8c4bf6ee62eb0627b270f0227. 2023-02-13 15:04:07,437 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:07,440 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:07,545 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42121,1676300644440; all regions closed. 2023-02-13 15:04:07,545 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 15:04:07,551 DEBUG [RS:0;jenkins-hbase20:42121] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/oldWALs 2023-02-13 15:04:07,551 INFO [RS:0;jenkins-hbase20:42121] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42121%2C1676300644440:(num 1676300645364) 2023-02-13 15:04:07,551 DEBUG [RS:0;jenkins-hbase20:42121] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:07,551 INFO [RS:0;jenkins-hbase20:42121] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:07,551 INFO [RS:0;jenkins-hbase20:42121] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:04:07,551 INFO [RS:0;jenkins-hbase20:42121] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:04:07,551 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:07,551 INFO [RS:0;jenkins-hbase20:42121] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:04:07,551 INFO [RS:0;jenkins-hbase20:42121] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:04:07,552 INFO [RS:0;jenkins-hbase20:42121] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42121 2023-02-13 15:04:07,553 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:07,553 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:07,553 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:07,553 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5297ab75 rejected from java.util.concurrent.ThreadPoolExecutor@56a835ff[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:07,554 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42121,1676300644440 2023-02-13 15:04:07,554 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:07,554 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42121,1676300644440] 2023-02-13 15:04:07,554 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42121,1676300644440; numProcessing=1 2023-02-13 15:04:07,554 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42121,1676300644440 already deleted, retry=false 2023-02-13 15:04:07,554 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42121,1676300644440 expired; onlineServers=1 2023-02-13 15:04:07,735 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 15:04:07,735 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 15:04:07,746 DEBUG [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 15:04:07,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/.tmp/rep_barrier/634fd23534cf4f3a8c29b378c4924430 2023-02-13 15:04:07,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 634fd23534cf4f3a8c29b378c4924430 2023-02-13 15:04:07,781 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/.tmp/table/700fb2a88d894e7980d8ca3d34e53a1c 2023-02-13 15:04:07,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 700fb2a88d894e7980d8ca3d34e53a1c 2023-02-13 15:04:07,785 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/.tmp/info/076a31c5379240e89efe44d0c7d26531 as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/info/076a31c5379240e89efe44d0c7d26531 2023-02-13 15:04:07,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 076a31c5379240e89efe44d0c7d26531 2023-02-13 15:04:07,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/info/076a31c5379240e89efe44d0c7d26531, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 15:04:07,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/.tmp/rep_barrier/634fd23534cf4f3a8c29b378c4924430 as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/rep_barrier/634fd23534cf4f3a8c29b378c4924430 2023-02-13 15:04:07,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 634fd23534cf4f3a8c29b378c4924430 2023-02-13 15:04:07,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/rep_barrier/634fd23534cf4f3a8c29b378c4924430, entries=1, sequenceid=21, filesize=5.1 K 2023-02-13 15:04:07,795 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/.tmp/table/700fb2a88d894e7980d8ca3d34e53a1c as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/table/700fb2a88d894e7980d8ca3d34e53a1c 2023-02-13 15:04:07,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 700fb2a88d894e7980d8ca3d34e53a1c 2023-02-13 15:04:07,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/table/700fb2a88d894e7980d8ca3d34e53a1c, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 15:04:07,799 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.47 KB/4577, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 454ms, sequenceid=21, compaction requested=false 2023-02-13 15:04:07,801 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 15:04:07,802 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:04:07,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:07,802 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300647345Running coprocessor pre-close hooks at 1676300647345Disabling compacts and flushes for region at 1676300647345Disabling writes for close at 1676300647345Obtaining lock to block concurrent updates at 1676300647346 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676300647346Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4577, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676300647346Flushing stores of hbase:meta,,1.1588230740 at 1676300647346Flushing 1588230740/info: creating writer at 1676300647346Flushing 1588230740/info: appending metadata at 1676300647348 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676300647348Flushing 1588230740/rep_barrier: creating writer at 1676300647362 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676300647365 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676300647365Flushing 1588230740/table: creating writer at 1676300647774 (+409 ms)Flushing 1588230740/table: appending metadata at 1676300647776 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676300647776Flushing 1588230740/info: reopening flushed file at 1676300647785 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676300647791 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676300647795 (+4 ms)Finished flush of dataSize ~4.47 KB/4577, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 454ms, sequenceid=21, compaction requested=false at 1676300647799 (+4 ms)Writing region close event to WAL at 1676300647799Running coprocessor post-close hooks at 1676300647802 (+3 ms)Closed at 1676300647802 2023-02-13 15:04:07,802 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:07,843 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:07,843 INFO [RS:0;jenkins-hbase20:42121] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42121,1676300644440; zookeeper connection closed. 2023-02-13 15:04:07,843 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dd03192 rejected from java.util.concurrent.ThreadPoolExecutor@56a835ff[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:07,844 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1015c5db1ca0001, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:07,844 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35e33922 rejected from java.util.concurrent.ThreadPoolExecutor@56a835ff[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:07,844 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a594e2c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a594e2c 2023-02-13 15:04:07,946 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33835,1676300644464; all regions closed. 2023-02-13 15:04:07,950 DEBUG [RS:1;jenkins-hbase20:33835] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/oldWALs 2023-02-13 15:04:07,950 INFO [RS:1;jenkins-hbase20:33835] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33835%2C1676300644464.meta:.meta(num 1676300644967) 2023-02-13 15:04:07,953 DEBUG [RS:1;jenkins-hbase20:33835] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/oldWALs 2023-02-13 15:04:07,953 INFO [RS:1;jenkins-hbase20:33835] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33835%2C1676300644464:(num 1676300645762) 2023-02-13 15:04:07,953 DEBUG [RS:1;jenkins-hbase20:33835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:07,953 INFO [RS:1;jenkins-hbase20:33835] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:07,953 INFO [RS:1;jenkins-hbase20:33835] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 15:04:07,953 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:07,954 INFO [RS:1;jenkins-hbase20:33835] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33835 2023-02-13 15:04:07,955 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33835,1676300644464 2023-02-13 15:04:07,955 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:07,955 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3eb60d3b rejected from java.util.concurrent.ThreadPoolExecutor@3a898e35[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:07,955 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,33835,1676300644464] 2023-02-13 15:04:07,955 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,33835,1676300644464; numProcessing=2 2023-02-13 15:04:07,956 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,33835,1676300644464 already deleted, retry=false 2023-02-13 15:04:07,956 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,33835,1676300644464 expired; onlineServers=0 2023-02-13 15:04:07,956 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,36953,1676300644398' ***** 2023-02-13 15:04:07,956 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 15:04:07,957 DEBUG [M:0;jenkins-hbase20:36953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a05bca7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:07,957 INFO [M:0;jenkins-hbase20:36953] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,36953,1676300644398 2023-02-13 15:04:07,957 INFO [M:0;jenkins-hbase20:36953] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,36953,1676300644398; all regions closed. 2023-02-13 15:04:07,957 DEBUG [M:0;jenkins-hbase20:36953] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:07,957 DEBUG [M:0;jenkins-hbase20:36953] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 15:04:07,957 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 15:04:07,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300644617] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300644617,5,FailOnTimeoutGroup] 2023-02-13 15:04:07,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300644617] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300644617,5,FailOnTimeoutGroup] 2023-02-13 15:04:07,957 DEBUG [M:0;jenkins-hbase20:36953] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 15:04:07,958 INFO [M:0;jenkins-hbase20:36953] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 15:04:07,958 INFO [M:0;jenkins-hbase20:36953] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 15:04:07,958 INFO [M:0;jenkins-hbase20:36953] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 15:04:07,959 DEBUG [M:0;jenkins-hbase20:36953] master.HMaster(1502): Stopping service threads 2023-02-13 15:04:07,959 INFO [M:0;jenkins-hbase20:36953] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 15:04:07,959 ERROR [M:0;jenkins-hbase20:36953] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 15:04:07,959 INFO [M:0;jenkins-hbase20:36953] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 15:04:07,959 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:07,959 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 15:04:07,959 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:07,959 DEBUG [M:0;jenkins-hbase20:36953] zookeeper.ZKUtil(398): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 15:04:07,960 WARN [M:0;jenkins-hbase20:36953] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 15:04:07,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:07,960 INFO [M:0;jenkins-hbase20:36953] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 15:04:07,960 INFO [M:0;jenkins-hbase20:36953] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 15:04:07,960 DEBUG [M:0;jenkins-hbase20:36953] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:04:07,960 INFO [M:0;jenkins-hbase20:36953] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:07,960 DEBUG [M:0;jenkins-hbase20:36953] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:07,960 DEBUG [M:0;jenkins-hbase20:36953] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:04:07,960 DEBUG [M:0;jenkins-hbase20:36953] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:07,960 INFO [M:0;jenkins-hbase20:36953] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.73 KB heapSize=67.73 KB 2023-02-13 15:04:07,968 INFO [M:0;jenkins-hbase20:36953] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.73 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f9e56e58c41f460586cba909ed0a8fcd 2023-02-13 15:04:07,971 DEBUG [M:0;jenkins-hbase20:36953] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f9e56e58c41f460586cba909ed0a8fcd as hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f9e56e58c41f460586cba909ed0a8fcd 2023-02-13 15:04:07,975 INFO [M:0;jenkins-hbase20:36953] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35783/user/jenkins/test-data/fae85e96-f1d1-02c9-4402-cc21c92cb88d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f9e56e58c41f460586cba909ed0a8fcd, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 15:04:07,975 INFO [M:0;jenkins-hbase20:36953] regionserver.HRegion(2947): Finished flush of dataSize ~56.73 KB/58089, heapSize ~67.72 KB/69344, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-13 15:04:07,977 INFO [M:0;jenkins-hbase20:36953] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:07,977 DEBUG [M:0;jenkins-hbase20:36953] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300647960Disabling compacts and flushes for region at 1676300647960Disabling writes for close at 1676300647960Obtaining lock to block concurrent updates at 1676300647960Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676300647960Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58089, getHeapSize=69344, getOffHeapSize=0, getCellsCount=145 at 1676300647961 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676300647962 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676300647962Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676300647963 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676300647963Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676300647972 (+9 ms)Finished flush of dataSize ~56.73 KB/58089, heapSize ~67.72 KB/69344, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false at 1676300647976 (+4 ms)Writing region close event to WAL at 1676300647977 (+1 ms)Closed at 1676300647977 2023-02-13 15:04:07,980 INFO [M:0;jenkins-hbase20:36953] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 15:04:07,980 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:07,981 INFO [M:0;jenkins-hbase20:36953] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36953 2023-02-13 15:04:07,982 DEBUG [M:0;jenkins-hbase20:36953] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,36953,1676300644398 already deleted, retry=false 2023-02-13 15:04:08,056 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:08,056 INFO [RS:1;jenkins-hbase20:33835] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33835,1676300644464; zookeeper connection closed. 2023-02-13 15:04:08,056 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40ef9e79 rejected from java.util.concurrent.ThreadPoolExecutor@3a898e35[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:08,056 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): regionserver:33835-0x1015c5db1ca0002, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:08,056 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1fbf6edc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1fbf6edc 2023-02-13 15:04:08,056 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38305b4e rejected from java.util.concurrent.ThreadPoolExecutor@3a898e35[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:08,056 INFO [Listener at localhost.localdomain/39887] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 15:04:08,156 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:08,156 INFO [M:0;jenkins-hbase20:36953] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,36953,1676300644398; zookeeper connection closed. 2023-02-13 15:04:08,156 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47f3bdc3 rejected from java.util.concurrent.ThreadPoolExecutor@43cc31e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:08,157 DEBUG [Listener at localhost.localdomain/39887-EventThread] zookeeper.ZKWatcher(600): master:36953-0x1015c5db1ca0000, quorum=127.0.0.1:53383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:08,157 ERROR [Listener at localhost.localdomain/39887-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d45a546 rejected from java.util.concurrent.ThreadPoolExecutor@43cc31e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:08,157 WARN [Listener at localhost.localdomain/39887] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:04:08,160 INFO [Listener at localhost.localdomain/39887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:04:08,264 WARN [BP-169537397-148.251.75.209-1676300643853 heartbeating to localhost.localdomain/127.0.0.1:35783] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:04:08,264 WARN [BP-169537397-148.251.75.209-1676300643853 heartbeating to localhost.localdomain/127.0.0.1:35783] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-169537397-148.251.75.209-1676300643853 (Datanode Uuid d029afb7-3a10-4903-801d-a336a3728d7f) service to localhost.localdomain/127.0.0.1:35783 2023-02-13 15:04:08,264 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0/dfs/data/data3/current/BP-169537397-148.251.75.209-1676300643853] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:08,264 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0/dfs/data/data4/current/BP-169537397-148.251.75.209-1676300643853] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:08,266 WARN [Listener at localhost.localdomain/39887] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:04:08,269 INFO [Listener at localhost.localdomain/39887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:04:08,373 WARN [BP-169537397-148.251.75.209-1676300643853 heartbeating to localhost.localdomain/127.0.0.1:35783] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:04:08,373 WARN [BP-169537397-148.251.75.209-1676300643853 heartbeating to localhost.localdomain/127.0.0.1:35783] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-169537397-148.251.75.209-1676300643853 (Datanode Uuid 0214844c-3c5a-49e5-9a06-b024a588e655) service to localhost.localdomain/127.0.0.1:35783 2023-02-13 15:04:08,374 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0/dfs/data/data1/current/BP-169537397-148.251.75.209-1676300643853] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:08,374 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/cluster_499750d2-ba85-4249-81f4-96799d1983a0/dfs/data/data2/current/BP-169537397-148.251.75.209-1676300643853] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:08,385 INFO [Listener at localhost.localdomain/39887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 15:04:08,496 INFO [Listener at localhost.localdomain/39887] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 15:04:08,514 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 15:04:08,525 INFO [Listener at localhost.localdomain/39887] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=278 (was 254) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:35783 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,36953,1676300644398)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:35783 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost.localdomain:35783 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:35783 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39887 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost.localdomain:35783 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:35783 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:35783 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=586 (was 668), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 248), ProcessCount=164 (was 164), AvailableMemoryMB=6834 (was 6892) 2023-02-13 15:04:08,535 INFO [Listener at localhost.localdomain/39887] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=278, OpenFileDescriptor=586, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=164, AvailableMemoryMB=6834 2023-02-13 15:04:08,543 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/hadoop.log.dir so I do NOT create it in target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820 2023-02-13 15:04:08,543 WARN [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 15:04:08,543 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/hadoop.tmp.dir so I do NOT create it in target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820 2023-02-13 15:04:08,543 WARN [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b32e639-638d-c27c-b358-16a31fb4a4f5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 15:04:08,543 DEBUG [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820 2023-02-13 15:04:08,544 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 15:04:08,544 INFO [Listener at localhost.localdomain/39887] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba, deleteOnExit=true 2023-02-13 15:04:08,544 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 15:04:08,544 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/test.cache.data in system properties and HBase conf 2023-02-13 15:04:08,544 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 15:04:08,544 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/hadoop.log.dir in system properties and HBase conf 2023-02-13 15:04:08,544 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 15:04:08,545 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 15:04:08,545 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 15:04:08,545 DEBUG [Listener at localhost.localdomain/39887] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 15:04:08,545 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:04:08,545 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 15:04:08,545 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 15:04:08,545 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/nfs.dump.dir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/java.io.tmpdir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 15:04:08,546 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 15:04:08,547 INFO [Listener at localhost.localdomain/39887] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 15:04:08,549 WARN [Listener at localhost.localdomain/39887] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:04:08,549 WARN [Listener at localhost.localdomain/39887] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:04:08,573 WARN [Listener at localhost.localdomain/39887] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:04:08,575 INFO [Listener at localhost.localdomain/39887] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:04:08,580 INFO [Listener at localhost.localdomain/39887] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/java.io.tmpdir/Jetty_localhost_localdomain_45531_hdfs____anpfkc/webapp 2023-02-13 15:04:08,652 INFO [Listener at localhost.localdomain/39887] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45531 2023-02-13 15:04:08,655 WARN [Listener at localhost.localdomain/39887] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 15:04:08,655 WARN [Listener at localhost.localdomain/39887] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 15:04:08,678 WARN [Listener at localhost.localdomain/38845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:04:08,692 WARN [Listener at localhost.localdomain/38845] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:04:08,693 WARN [Listener at localhost.localdomain/38845] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:04:08,694 INFO [Listener at localhost.localdomain/38845] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:04:08,700 INFO [Listener at localhost.localdomain/38845] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/java.io.tmpdir/Jetty_localhost_38839_datanode____.h469og/webapp 2023-02-13 15:04:08,783 INFO [Listener at localhost.localdomain/38845] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38839 2023-02-13 15:04:08,795 WARN [Listener at localhost.localdomain/35365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:04:08,811 WARN [Listener at localhost.localdomain/35365] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 15:04:08,813 WARN [Listener at localhost.localdomain/35365] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 15:04:08,814 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 15:04:08,817 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/java.io.tmpdir/Jetty_localhost_35397_datanode____.eugwiy/webapp 2023-02-13 15:04:08,872 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe99737d2c041115f: Processing first storage report for DS-20be8a63-c930-431f-bd65-96fcf3b9fe46 from datanode 08085199-bc47-470d-835b-643814e730c6 2023-02-13 15:04:08,873 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe99737d2c041115f: from storage DS-20be8a63-c930-431f-bd65-96fcf3b9fe46 node DatanodeRegistration(127.0.0.1:42551, datanodeUuid=08085199-bc47-470d-835b-643814e730c6, infoPort=44245, infoSecurePort=0, ipcPort=35365, storageInfo=lv=-57;cid=testClusterID;nsid=927950068;c=1676300648550), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:08,873 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe99737d2c041115f: Processing first storage report for DS-35db1d72-6dac-40c9-bc1c-7834804b520e from datanode 08085199-bc47-470d-835b-643814e730c6 2023-02-13 15:04:08,873 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe99737d2c041115f: from storage DS-35db1d72-6dac-40c9-bc1c-7834804b520e node DatanodeRegistration(127.0.0.1:42551, datanodeUuid=08085199-bc47-470d-835b-643814e730c6, infoPort=44245, infoSecurePort=0, ipcPort=35365, storageInfo=lv=-57;cid=testClusterID;nsid=927950068;c=1676300648550), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:08,907 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35397 2023-02-13 15:04:08,915 WARN [Listener at localhost.localdomain/38593] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 15:04:08,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f03a42ec003f84: Processing first storage report for DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7 from datanode dc649e29-8b43-46bc-a26b-e793db8509db 2023-02-13 15:04:08,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f03a42ec003f84: from storage DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7 node DatanodeRegistration(127.0.0.1:40769, datanodeUuid=dc649e29-8b43-46bc-a26b-e793db8509db, infoPort=38899, infoSecurePort=0, ipcPort=38593, storageInfo=lv=-57;cid=testClusterID;nsid=927950068;c=1676300648550), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:08,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f03a42ec003f84: Processing first storage report for DS-2ebc0411-e7c8-493c-ab51-6c1e1d0f2f46 from datanode dc649e29-8b43-46bc-a26b-e793db8509db 2023-02-13 15:04:08,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f03a42ec003f84: from storage DS-2ebc0411-e7c8-493c-ab51-6c1e1d0f2f46 node DatanodeRegistration(127.0.0.1:40769, datanodeUuid=dc649e29-8b43-46bc-a26b-e793db8509db, infoPort=38899, infoSecurePort=0, ipcPort=38593, storageInfo=lv=-57;cid=testClusterID;nsid=927950068;c=1676300648550), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 15:04:09,024 DEBUG [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820 2023-02-13 15:04:09,026 INFO [Listener at localhost.localdomain/38593] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba/zookeeper_0, clientPort=58606, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 15:04:09,027 INFO [Listener at localhost.localdomain/38593] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58606 2023-02-13 15:04:09,027 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,028 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,040 INFO [Listener at localhost.localdomain/38593] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd with version=8 2023-02-13 15:04:09,040 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,041 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,042 INFO [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/hbase-staging 2023-02-13 15:04:09,043 INFO [Listener at localhost.localdomain/38593] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:04:09,043 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,043 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,044 INFO [Listener at localhost.localdomain/38593] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:04:09,044 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,044 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:04:09,044 INFO [Listener at localhost.localdomain/38593] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:04:09,044 INFO [Listener at localhost.localdomain/38593] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41393 2023-02-13 15:04:09,045 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,045 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,046 INFO [Listener at localhost.localdomain/38593] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41393 connecting to ZooKeeper ensemble=127.0.0.1:58606 2023-02-13 15:04:09,051 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:413930x0, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:04:09,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41393-0x1015c5dc3f10000 connected 2023-02-13 15:04:09,066 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:09,066 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:09,066 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:04:09,071 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41393 2023-02-13 15:04:09,071 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41393 2023-02-13 15:04:09,071 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41393 2023-02-13 15:04:09,075 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41393 2023-02-13 15:04:09,075 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41393 2023-02-13 15:04:09,075 INFO [Listener at localhost.localdomain/38593] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd, hbase.cluster.distributed=false 2023-02-13 15:04:09,087 INFO [Listener at localhost.localdomain/38593] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:04:09,087 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,087 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,087 INFO [Listener at localhost.localdomain/38593] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:04:09,088 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,088 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:04:09,088 INFO [Listener at localhost.localdomain/38593] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:04:09,088 INFO [Listener at localhost.localdomain/38593] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36557 2023-02-13 15:04:09,089 INFO [Listener at localhost.localdomain/38593] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:04:09,091 DEBUG [Listener at localhost.localdomain/38593] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:04:09,092 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,093 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,093 INFO [Listener at localhost.localdomain/38593] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36557 connecting to ZooKeeper ensemble=127.0.0.1:58606 2023-02-13 15:04:09,103 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:365570x0, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:04:09,103 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): regionserver:365570x0, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:09,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36557-0x1015c5dc3f10001 connected 2023-02-13 15:04:09,106 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:09,106 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:04:09,107 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36557 2023-02-13 15:04:09,111 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36557 2023-02-13 15:04:09,111 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36557 2023-02-13 15:04:09,111 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36557 2023-02-13 15:04:09,111 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36557 2023-02-13 15:04:09,120 INFO [Listener at localhost.localdomain/38593] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-13 15:04:09,120 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,120 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,120 INFO [Listener at localhost.localdomain/38593] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 15:04:09,120 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 15:04:09,120 INFO [Listener at localhost.localdomain/38593] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 15:04:09,120 INFO [Listener at localhost.localdomain/38593] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 15:04:09,121 INFO [Listener at localhost.localdomain/38593] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34595 2023-02-13 15:04:09,121 INFO [Listener at localhost.localdomain/38593] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 15:04:09,121 DEBUG [Listener at localhost.localdomain/38593] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:04:09,122 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,122 INFO [Listener at localhost.localdomain/38593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,123 INFO [Listener at localhost.localdomain/38593] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34595 connecting to ZooKeeper ensemble=127.0.0.1:58606 2023-02-13 15:04:09,128 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:345950x0, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 15:04:09,128 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): regionserver:345950x0, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:09,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34595-0x1015c5dc3f10002 connected 2023-02-13 15:04:09,129 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:09,129 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ZKUtil(164): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 15:04:09,130 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34595 2023-02-13 15:04:09,131 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34595 2023-02-13 15:04:09,135 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34595 2023-02-13 15:04:09,135 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34595 2023-02-13 15:04:09,135 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34595 2023-02-13 15:04:09,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:09,144 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:04:09,144 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:09,147 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:09,147 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:09,147 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:09,149 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:09,150 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:04:09,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 15:04:09,151 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,41393,1676300649043 from backup master directory 2023-02-13 15:04:09,151 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:09,151 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 15:04:09,151 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:09,151 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:09,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/hbase.id with ID: 6747c94d-d039-4b8a-b4c4-c212ad562b17 2023-02-13 15:04:09,168 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 15:04:09,169 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:09,175 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3b9dbe42 to 127.0.0.1:58606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:09,181 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@369b0340, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:09,181 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:09,182 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 15:04:09,183 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:09,184 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store-tmp 2023-02-13 15:04:09,192 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:09,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:04:09,193 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:09,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:09,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:04:09,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:09,193 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:09,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300649193Disabling compacts and flushes for region at 1676300649193Disabling writes for close at 1676300649193Writing region close event to WAL at 1676300649193Closed at 1676300649193 2023-02-13 15:04:09,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/WALs/jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:09,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41393%2C1676300649043, suffix=, logDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/WALs/jenkins-hbase20.apache.org,41393,1676300649043, archiveDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/oldWALs, maxLogs=10 2023-02-13 15:04:09,205 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK] 2023-02-13 15:04:09,205 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK] 2023-02-13 15:04:09,206 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/WALs/jenkins-hbase20.apache.org,41393,1676300649043/jenkins-hbase20.apache.org%2C41393%2C1676300649043.1676300649195 2023-02-13 15:04:09,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK], DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK]] 2023-02-13 15:04:09,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:09,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:09,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:09,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:09,208 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:09,209 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 15:04:09,210 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 15:04:09,210 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:09,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:09,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:09,213 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 15:04:09,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:09,215 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65715111, jitterRate=-0.020768538117408752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:04:09,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676300649207Initializing all the Stores at 1676300649208 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300649208Cleaning up temporary data from old regions at 1676300649212 (+4 ms)Cleaning up detritus from prior splits at 1676300649212Region opened successfully at 1676300649216 (+4 ms) 2023-02-13 15:04:09,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 15:04:09,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 15:04:09,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 15:04:09,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 15:04:09,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 15:04:09,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 15:04:09,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 15:04:09,222 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 15:04:09,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 15:04:09,230 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 15:04:09,230 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 15:04:09,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 15:04:09,231 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 15:04:09,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 15:04:09,233 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:09,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 15:04:09,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 15:04:09,234 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 15:04:09,234 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:09,234 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:09,235 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:09,234 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:09,235 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,41393,1676300649043, sessionid=0x1015c5dc3f10000, setting cluster-up flag (Was=false) 2023-02-13 15:04:09,238 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:09,240 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 15:04:09,240 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:09,242 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:09,243 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 15:04:09,244 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:09,244 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.hbase-snapshot/.tmp 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:09,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676300679257 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 15:04:09,257 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:04:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,257 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 15:04:09,258 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 15:04:09,258 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 15:04:09,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 15:04:09,259 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:09,263 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 15:04:09,263 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 15:04:09,264 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300649263,5,FailOnTimeoutGroup] 2023-02-13 15:04:09,264 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300649264,5,FailOnTimeoutGroup] 2023-02-13 15:04:09,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 15:04:09,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,273 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:09,274 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:09,274 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd 2023-02-13 15:04:09,284 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:09,286 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:04:09,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/info 2023-02-13 15:04:09,287 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:04:09,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:09,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:04:09,288 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:09,288 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:04:09,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:09,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:04:09,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/table 2023-02-13 15:04:09,290 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:04:09,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:09,291 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740 2023-02-13 15:04:09,291 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740 2023-02-13 15:04:09,292 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:04:09,293 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:04:09,294 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:09,295 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67516318, jitterRate=0.006071537733078003}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:04:09,295 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676300649285Initializing all the Stores at 1676300649285Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300649285Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300649285Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300649285Cleaning up temporary data from old regions at 1676300649292 (+7 ms)Cleaning up detritus from prior splits at 1676300649292Region opened successfully at 1676300649295 (+3 ms) 2023-02-13 15:04:09,295 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:04:09,295 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:04:09,295 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:04:09,295 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:04:09,295 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:04:09,295 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:09,295 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300649295Disabling compacts and flushes for region at 1676300649295Disabling writes for close at 1676300649295Writing region close event to WAL at 1676300649295Closed at 1676300649295 2023-02-13 15:04:09,296 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 15:04:09,296 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 15:04:09,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 15:04:09,297 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 15:04:09,298 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 15:04:09,338 INFO [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(952): ClusterId : 6747c94d-d039-4b8a-b4c4-c212ad562b17 2023-02-13 15:04:09,338 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(952): ClusterId : 6747c94d-d039-4b8a-b4c4-c212ad562b17 2023-02-13 15:04:09,338 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:04:09,338 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 15:04:09,339 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:04:09,339 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:04:09,339 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 15:04:09,339 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 15:04:09,340 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:04:09,341 DEBUG [RS:1;jenkins-hbase20:34595] zookeeper.ReadOnlyZKClient(139): Connect 0x345468f4 to 127.0.0.1:58606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:09,341 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 15:04:09,342 DEBUG [RS:0;jenkins-hbase20:36557] zookeeper.ReadOnlyZKClient(139): Connect 0x375232d4 to 127.0.0.1:58606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:09,344 DEBUG [RS:0;jenkins-hbase20:36557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3995ca4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:09,344 DEBUG [RS:1;jenkins-hbase20:34595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a93800e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:09,344 DEBUG [RS:0;jenkins-hbase20:36557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3daa59a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:09,344 DEBUG [RS:1;jenkins-hbase20:34595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eac0384, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:09,351 DEBUG [RS:1;jenkins-hbase20:34595] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:34595 2023-02-13 15:04:09,351 INFO [RS:1;jenkins-hbase20:34595] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:04:09,351 INFO [RS:1;jenkins-hbase20:34595] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:04:09,351 DEBUG [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:04:09,352 INFO [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,41393,1676300649043 with isa=jenkins-hbase20.apache.org/148.251.75.209:34595, startcode=1676300649119 2023-02-13 15:04:09,352 DEBUG [RS:1;jenkins-hbase20:34595] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:04:09,352 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:36557 2023-02-13 15:04:09,352 INFO [RS:0;jenkins-hbase20:36557] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 15:04:09,352 INFO [RS:0;jenkins-hbase20:36557] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 15:04:09,352 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 15:04:09,352 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,41393,1676300649043 with isa=jenkins-hbase20.apache.org/148.251.75.209:36557, startcode=1676300649086 2023-02-13 15:04:09,352 DEBUG [RS:0;jenkins-hbase20:36557] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 15:04:09,353 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53143, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:04:09,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:09,355 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41107, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 15:04:09,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,355 DEBUG [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd 2023-02-13 15:04:09,355 DEBUG [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:38845 2023-02-13 15:04:09,355 DEBUG [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:04:09,355 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd 2023-02-13 15:04:09,356 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:38845 2023-02-13 15:04:09,356 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 15:04:09,361 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:09,362 DEBUG [RS:1;jenkins-hbase20:34595] zookeeper.ZKUtil(162): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:09,362 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,36557,1676300649086] 2023-02-13 15:04:09,362 WARN [RS:1;jenkins-hbase20:34595] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:09,362 DEBUG [RS:0;jenkins-hbase20:36557] zookeeper.ZKUtil(162): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,363 INFO [RS:1;jenkins-hbase20:34595] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:09,362 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34595,1676300649119] 2023-02-13 15:04:09,363 WARN [RS:0;jenkins-hbase20:36557] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 15:04:09,363 DEBUG [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:09,363 INFO [RS:0;jenkins-hbase20:36557] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:09,363 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,369 DEBUG [RS:0;jenkins-hbase20:36557] zookeeper.ZKUtil(162): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,369 DEBUG [RS:1;jenkins-hbase20:34595] zookeeper.ZKUtil(162): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,369 DEBUG [RS:0;jenkins-hbase20:36557] zookeeper.ZKUtil(162): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:09,369 DEBUG [RS:1;jenkins-hbase20:34595] zookeeper.ZKUtil(162): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:09,370 DEBUG [RS:1;jenkins-hbase20:34595] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:04:09,370 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 15:04:09,370 INFO [RS:1;jenkins-hbase20:34595] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:04:09,370 INFO [RS:0;jenkins-hbase20:36557] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 15:04:09,371 INFO [RS:1;jenkins-hbase20:34595] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:04:09,375 INFO [RS:1;jenkins-hbase20:34595] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:04:09,375 INFO [RS:0;jenkins-hbase20:36557] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 15:04:09,375 INFO [RS:1;jenkins-hbase20:34595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,375 INFO [RS:0;jenkins-hbase20:36557] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 15:04:09,375 INFO [RS:0;jenkins-hbase20:36557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,375 INFO [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:04:09,378 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 15:04:09,380 INFO [RS:0;jenkins-hbase20:36557] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,380 INFO [RS:1;jenkins-hbase20:34595] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,380 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,380 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,380 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,380 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,380 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,380 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,380 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,380 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:09,381 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 15:04:09,381 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:0;jenkins-hbase20:36557] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,381 DEBUG [RS:1;jenkins-hbase20:34595] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 15:04:09,388 INFO [RS:1;jenkins-hbase20:34595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,388 INFO [RS:1;jenkins-hbase20:34595] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,388 INFO [RS:1;jenkins-hbase20:34595] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,388 INFO [RS:0;jenkins-hbase20:36557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,388 INFO [RS:0;jenkins-hbase20:36557] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,388 INFO [RS:0;jenkins-hbase20:36557] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,399 INFO [RS:1;jenkins-hbase20:34595] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:04:09,399 INFO [RS:1;jenkins-hbase20:34595] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34595,1676300649119-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,403 INFO [RS:0;jenkins-hbase20:36557] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 15:04:09,403 INFO [RS:0;jenkins-hbase20:36557] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36557,1676300649086-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,411 INFO [RS:1;jenkins-hbase20:34595] regionserver.Replication(203): jenkins-hbase20.apache.org,34595,1676300649119 started 2023-02-13 15:04:09,411 INFO [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34595,1676300649119, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34595, sessionid=0x1015c5dc3f10002 2023-02-13 15:04:09,411 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:04:09,411 DEBUG [RS:1;jenkins-hbase20:34595] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:09,411 DEBUG [RS:1;jenkins-hbase20:34595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34595,1676300649119' 2023-02-13 15:04:09,411 DEBUG [RS:1;jenkins-hbase20:34595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:09,411 DEBUG [RS:1;jenkins-hbase20:34595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:09,412 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:04:09,412 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:04:09,412 DEBUG [RS:1;jenkins-hbase20:34595] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:09,412 DEBUG [RS:1;jenkins-hbase20:34595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34595,1676300649119' 2023-02-13 15:04:09,412 DEBUG [RS:1;jenkins-hbase20:34595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:09,412 DEBUG [RS:1;jenkins-hbase20:34595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:09,412 DEBUG [RS:1;jenkins-hbase20:34595] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:04:09,412 INFO [RS:1;jenkins-hbase20:34595] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:04:09,412 INFO [RS:1;jenkins-hbase20:34595] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:04:09,417 INFO [RS:0;jenkins-hbase20:36557] regionserver.Replication(203): jenkins-hbase20.apache.org,36557,1676300649086 started 2023-02-13 15:04:09,417 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,36557,1676300649086, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:36557, sessionid=0x1015c5dc3f10001 2023-02-13 15:04:09,417 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 15:04:09,417 DEBUG [RS:0;jenkins-hbase20:36557] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,417 DEBUG [RS:0;jenkins-hbase20:36557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36557,1676300649086' 2023-02-13 15:04:09,417 DEBUG [RS:0;jenkins-hbase20:36557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:09,418 DEBUG [RS:0;jenkins-hbase20:36557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:09,418 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 15:04:09,418 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 15:04:09,418 DEBUG [RS:0;jenkins-hbase20:36557] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,418 DEBUG [RS:0;jenkins-hbase20:36557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36557,1676300649086' 2023-02-13 15:04:09,418 DEBUG [RS:0;jenkins-hbase20:36557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:09,418 DEBUG [RS:0;jenkins-hbase20:36557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:09,419 DEBUG [RS:0;jenkins-hbase20:36557] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 15:04:09,419 INFO [RS:0;jenkins-hbase20:36557] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 15:04:09,419 INFO [RS:0;jenkins-hbase20:36557] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 15:04:09,448 DEBUG [jenkins-hbase20:41393] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 15:04:09,448 DEBUG [jenkins-hbase20:41393] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:09,450 DEBUG [jenkins-hbase20:41393] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:09,450 DEBUG [jenkins-hbase20:41393] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:09,450 DEBUG [jenkins-hbase20:41393] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:09,450 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36557,1676300649086, state=OPENING 2023-02-13 15:04:09,451 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 15:04:09,451 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:09,452 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:04:09,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36557,1676300649086}] 2023-02-13 15:04:09,457 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 15:04:09,606 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,606 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:04:09,608 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:04:09,612 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 15:04:09,612 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 15:04:09,614 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36557%2C1676300649086.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,36557,1676300649086, archiveDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/oldWALs, maxLogs=32 2023-02-13 15:04:09,628 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK] 2023-02-13 15:04:09,628 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK] 2023-02-13 15:04:09,629 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,36557,1676300649086/jenkins-hbase20.apache.org%2C36557%2C1676300649086.meta.1676300649614.meta 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK], DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK]] 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 15:04:09,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 15:04:09,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 15:04:09,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 15:04:09,634 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/info 2023-02-13 15:04:09,634 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/info 2023-02-13 15:04:09,635 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 15:04:09,635 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:09,635 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 15:04:09,636 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:09,636 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/rep_barrier 2023-02-13 15:04:09,636 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 15:04:09,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:09,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 15:04:09,638 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/table 2023-02-13 15:04:09,638 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/table 2023-02-13 15:04:09,638 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 15:04:09,638 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:09,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740 2023-02-13 15:04:09,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740 2023-02-13 15:04:09,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 15:04:09,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 15:04:09,642 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74878148, jitterRate=0.1157713532447815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 15:04:09,642 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676300649630Writing region info on filesystem at 1676300649630Initializing all the Stores at 1676300649631 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300649631Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300649633 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300649633Cleaning up temporary data from old regions at 1676300649640 (+7 ms)Cleaning up detritus from prior splits at 1676300649640Running coprocessor post-open hooks at 1676300649642 (+2 ms)Region opened successfully at 1676300649642 2023-02-13 15:04:09,642 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676300649606 2023-02-13 15:04:09,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 15:04:09,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 15:04:09,648 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36557,1676300649086, state=OPEN 2023-02-13 15:04:09,649 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 15:04:09,649 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 15:04:09,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 15:04:09,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36557,1676300649086 in 197 msec 2023-02-13 15:04:09,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 15:04:09,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-13 15:04:09,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 406 msec 2023-02-13 15:04:09,652 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676300649144, completionTime=-1 2023-02-13 15:04:09,652 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 15:04:09,652 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 15:04:09,654 DEBUG [hconnection-0x144973f3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:09,656 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42318, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:09,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 15:04:09,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676300709657 2023-02-13 15:04:09,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676300769657 2023-02-13 15:04:09,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 15:04:09,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41393,1676300649043-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41393,1676300649043-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41393,1676300649043-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:41393, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 15:04:09,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 15:04:09,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:09,667 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 15:04:09,668 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 15:04:09,668 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:04:09,669 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:04:09,670 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:09,670 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0 empty. 2023-02-13 15:04:09,671 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:09,671 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 15:04:09,679 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:09,680 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f926c3fe1a319b34a03c84f5ad13cde0, NAME => 'hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp 2023-02-13 15:04:09,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:09,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f926c3fe1a319b34a03c84f5ad13cde0, disabling compactions & flushes 2023-02-13 15:04:09,686 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:09,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:09,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. after waiting 0 ms 2023-02-13 15:04:09,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:09,686 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:09,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f926c3fe1a319b34a03c84f5ad13cde0: Waiting for close lock at 1676300649686Disabling compacts and flushes for region at 1676300649686Disabling writes for close at 1676300649686Writing region close event to WAL at 1676300649686Closed at 1676300649686 2023-02-13 15:04:09,687 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:04:09,688 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300649688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300649688"}]},"ts":"1676300649688"} 2023-02-13 15:04:09,689 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:04:09,690 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:04:09,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300649690"}]},"ts":"1676300649690"} 2023-02-13 15:04:09,691 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 15:04:09,692 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:09,693 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:09,693 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:09,693 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:09,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f926c3fe1a319b34a03c84f5ad13cde0, ASSIGN}] 2023-02-13 15:04:09,695 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f926c3fe1a319b34a03c84f5ad13cde0, ASSIGN 2023-02-13 15:04:09,695 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f926c3fe1a319b34a03c84f5ad13cde0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36557,1676300649086; forceNewPlan=false, retain=false 2023-02-13 15:04:09,846 INFO [jenkins-hbase20:41393] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:04:09,846 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f926c3fe1a319b34a03c84f5ad13cde0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:09,846 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300649846"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300649846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300649846"}]},"ts":"1676300649846"} 2023-02-13 15:04:09,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f926c3fe1a319b34a03c84f5ad13cde0, server=jenkins-hbase20.apache.org,36557,1676300649086}] 2023-02-13 15:04:10,002 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:10,004 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36557%2C1676300649086, suffix=, logDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,36557,1676300649086, archiveDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/oldWALs, maxLogs=32 2023-02-13 15:04:10,014 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK] 2023-02-13 15:04:10,014 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK] 2023-02-13 15:04:10,016 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,36557,1676300649086/jenkins-hbase20.apache.org%2C36557%2C1676300649086.1676300650004 2023-02-13 15:04:10,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK], DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK]] 2023-02-13 15:04:10,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f926c3fe1a319b34a03c84f5ad13cde0, NAME => 'hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:10,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:10,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:10,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:10,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:10,018 INFO [StoreOpener-f926c3fe1a319b34a03c84f5ad13cde0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:10,019 DEBUG [StoreOpener-f926c3fe1a319b34a03c84f5ad13cde0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/info 2023-02-13 15:04:10,019 DEBUG [StoreOpener-f926c3fe1a319b34a03c84f5ad13cde0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/info 2023-02-13 15:04:10,019 INFO [StoreOpener-f926c3fe1a319b34a03c84f5ad13cde0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f926c3fe1a319b34a03c84f5ad13cde0 columnFamilyName info 2023-02-13 15:04:10,020 INFO [StoreOpener-f926c3fe1a319b34a03c84f5ad13cde0-1] regionserver.HStore(310): Store=f926c3fe1a319b34a03c84f5ad13cde0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:10,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:10,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:10,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:10,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:10,024 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f926c3fe1a319b34a03c84f5ad13cde0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70539942, jitterRate=0.05112704634666443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 15:04:10,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f926c3fe1a319b34a03c84f5ad13cde0: Running coprocessor pre-open hook at 1676300650017Writing region info on filesystem at 1676300650017Initializing all the Stores at 1676300650018 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676300650018Cleaning up temporary data from old regions at 1676300650021 (+3 ms)Cleaning up detritus from prior splits at 1676300650021Running coprocessor post-open hooks at 1676300650024 (+3 ms)Region opened successfully at 1676300650024 2023-02-13 15:04:10,025 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0., pid=6, masterSystemTime=1676300649999 2023-02-13 15:04:10,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:10,027 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:10,028 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f926c3fe1a319b34a03c84f5ad13cde0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:10,028 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676300650028"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300650028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300650028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300650028"}]},"ts":"1676300650028"} 2023-02-13 15:04:10,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 15:04:10,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f926c3fe1a319b34a03c84f5ad13cde0, server=jenkins-hbase20.apache.org,36557,1676300649086 in 181 msec 2023-02-13 15:04:10,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 15:04:10,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f926c3fe1a319b34a03c84f5ad13cde0, ASSIGN in 337 msec 2023-02-13 15:04:10,031 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:04:10,032 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300650031"}]},"ts":"1676300650031"} 2023-02-13 15:04:10,033 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 15:04:10,034 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:04:10,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 368 msec 2023-02-13 15:04:10,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 15:04:10,069 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:10,069 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:10,072 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 15:04:10,081 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:10,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-13 15:04:10,094 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 15:04:10,099 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 15:04:10,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 15:04:10,106 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 15:04:10,108 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 15:04:10,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.957sec 2023-02-13 15:04:10,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 15:04:10,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 15:04:10,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 15:04:10,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41393,1676300649043-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 15:04:10,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41393,1676300649043-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 15:04:10,109 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 15:04:10,138 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ReadOnlyZKClient(139): Connect 0x0e250560 to 127.0.0.1:58606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:10,140 DEBUG [Listener at localhost.localdomain/38593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9195752, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:10,142 DEBUG [hconnection-0x7391e5bf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:10,143 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42328, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:10,144 INFO [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:10,144 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 15:04:10,146 DEBUG [Listener at localhost.localdomain/38593] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 15:04:10,148 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58320, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 15:04:10,148 INFO [Listener at localhost.localdomain/38593] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 15:04:10,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-13 15:04:10,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 15:04:10,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 148.251.75.209:58320 deadline: 1676300710148, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 15:04:10,149 INFO [Listener at localhost.localdomain/38593] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 15:04:10,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 15:04:10,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 15:04:10,153 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 15:04:10,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 15:04:10,154 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 15:04:10,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:10,155 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,155 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939 empty. 2023-02-13 15:04:10,156 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 15:04:10,163 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 15:04:10,164 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ea81535be0674005983889a4f387f939, NAME => 'testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp 2023-02-13 15:04:10,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:10,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ea81535be0674005983889a4f387f939, disabling compactions & flushes 2023-02-13 15:04:10,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. after waiting 0 ms 2023-02-13 15:04:10,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ea81535be0674005983889a4f387f939: Waiting for close lock at 1676300650169Disabling compacts and flushes for region at 1676300650169Disabling writes for close at 1676300650169Writing region close event to WAL at 1676300650169Closed at 1676300650169 2023-02-13 15:04:10,171 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 15:04:10,172 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676300650171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300650171"}]},"ts":"1676300650171"} 2023-02-13 15:04:10,173 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 15:04:10,173 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 15:04:10,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300650173"}]},"ts":"1676300650173"} 2023-02-13 15:04:10,174 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 15:04:10,176 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-13 15:04:10,177 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 15:04:10,177 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 15:04:10,177 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 15:04:10,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ea81535be0674005983889a4f387f939, ASSIGN}] 2023-02-13 15:04:10,179 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ea81535be0674005983889a4f387f939, ASSIGN 2023-02-13 15:04:10,179 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ea81535be0674005983889a4f387f939, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34595,1676300649119; forceNewPlan=false, retain=false 2023-02-13 15:04:10,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:10,329 INFO [jenkins-hbase20:41393] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 15:04:10,330 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ea81535be0674005983889a4f387f939, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:10,330 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676300650330"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300650330"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300650330"}]},"ts":"1676300650330"} 2023-02-13 15:04:10,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ea81535be0674005983889a4f387f939, server=jenkins-hbase20.apache.org,34595,1676300649119}] 2023-02-13 15:04:10,414 INFO [RS:1;jenkins-hbase20:34595] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34595%2C1676300649119, suffix=, logDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,34595,1676300649119, archiveDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/oldWALs, maxLogs=32 2023-02-13 15:04:10,427 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK] 2023-02-13 15:04:10,427 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK] 2023-02-13 15:04:10,429 INFO [RS:1;jenkins-hbase20:34595] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/WALs/jenkins-hbase20.apache.org,34595,1676300649119/jenkins-hbase20.apache.org%2C34595%2C1676300649119.1676300650414 2023-02-13 15:04:10,429 DEBUG [RS:1;jenkins-hbase20:34595] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40769,DS-e8def87f-1aeb-40e4-b2ed-5cca0af7a7b7,DISK], DatanodeInfoWithStorage[127.0.0.1:42551,DS-20be8a63-c930-431f-bd65-96fcf3b9fe46,DISK]] 2023-02-13 15:04:10,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:10,484 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:10,484 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 15:04:10,486 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 15:04:10,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ea81535be0674005983889a4f387f939, NAME => 'testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.', STARTKEY => '', ENDKEY => ''} 2023-02-13 15:04:10,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:10,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,490 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,491 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1 2023-02-13 15:04:10,491 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1 2023-02-13 15:04:10,491 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea81535be0674005983889a4f387f939 columnFamilyName f1 2023-02-13 15:04:10,492 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(310): Store=ea81535be0674005983889a4f387f939/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:10,492 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,493 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2 2023-02-13 15:04:10,493 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2 2023-02-13 15:04:10,493 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea81535be0674005983889a4f387f939 columnFamilyName f2 2023-02-13 15:04:10,493 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(310): Store=ea81535be0674005983889a4f387f939/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:10,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:04:10,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for ea81535be0674005983889a4f387f939 2023-02-13 15:04:10,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 15:04:10,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened ea81535be0674005983889a4f387f939; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64370230, jitterRate=-0.04080882668495178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:04:10,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for ea81535be0674005983889a4f387f939: Running coprocessor pre-open hook at 1676300650489Writing region info on filesystem at 1676300650489Initializing all the Stores at 1676300650490 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300650490Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300650490Cleaning up temporary data from old regions at 1676300650494 (+4 ms)Cleaning up detritus from prior splits at 1676300650495 (+1 ms)Running coprocessor post-open hooks at 1676300650497 (+2 ms)Region opened successfully at 1676300650497 2023-02-13 15:04:10,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939., pid=12, masterSystemTime=1676300650484 2023-02-13 15:04:10,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ea81535be0674005983889a4f387f939, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:10,502 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676300650502"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676300650502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676300650502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676300650502"}]},"ts":"1676300650502"} 2023-02-13 15:04:10,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 15:04:10,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ea81535be0674005983889a4f387f939, server=jenkins-hbase20.apache.org,34595,1676300649119 in 173 msec 2023-02-13 15:04:10,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 15:04:10,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ea81535be0674005983889a4f387f939, ASSIGN in 327 msec 2023-02-13 15:04:10,507 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 15:04:10,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300650507"}]},"ts":"1676300650507"} 2023-02-13 15:04:10,508 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 15:04:10,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 15:04:10,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 358 msec 2023-02-13 15:04:10,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 15:04:10,759 INFO [Listener at localhost.localdomain/38593] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 15:04:10,759 DEBUG [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 15:04:10,759 INFO [Listener at localhost.localdomain/38593] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:04:10,761 INFO [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 15:04:10,761 INFO [Listener at localhost.localdomain/38593] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 15:04:10,761 INFO [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 15:04:10,761 INFO [Listener at localhost.localdomain/38593] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 15:04:10,773 DEBUG [hconnection-0x7391e5bf-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:10,781 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:10,787 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34595] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:10,858 INFO [Listener at localhost.localdomain/38593] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 15:04:10,858 INFO [Listener at localhost.localdomain/38593] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 15:04:10,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:04:10,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676300650859 (current time:1676300650859). 2023-02-13 15:04:10,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 15:04:10,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] zookeeper.ReadOnlyZKClient(139): Connect 0x1ae5ba4a to 127.0.0.1:58606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 15:04:11,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4336321b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 15:04:11,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 15:04:11,103 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42334, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 15:04:11,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ae5ba4a to 127.0.0.1:58606 2023-02-13 15:04:11,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:11,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 15:04:11,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:04:11,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:04:11,108 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:04:11,109 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676301251109 2023-02-13 15:04:11,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 15:04:11,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 15:04:11,111 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 15:04:11,115 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 15:04:11,115 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 15:04:11,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:04:11,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-13 15:04:11,117 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:04:11,118 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676301251118 2023-02-13 15:04:11,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-13 15:04:11,133 INFO [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-13 15:04:11,133 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:11,134 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-13 15:04:11,134 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 15:04:11,215 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:11,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:04:11,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:04:11,216 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 15:04:11,416 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:11,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:04:11,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:04:11,418 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 15:04:11,718 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:11,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:04:11,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 15:04:11,720 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 15:04:11,721 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:11,721 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 15:04:12,028 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:12,029 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,028 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:12,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:12,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:12,029 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,029 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:04:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 15:04:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 15:04:12,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 15:04:12,030 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 15:04:12,030 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 15:04:12,030 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:12,030 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 15:04:12,031 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 15:04:12,033 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 15:04:12,034 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 15:04:12,033 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 15:04:12,034 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34595,1676300649119' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 15:04:12,034 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36557,1676300649086' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 15:04:12,071 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,071 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:12,071 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:12,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:12,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:12,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 15:04:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:12,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34595,1676300649119' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-13 15:04:12,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fa64912[Count = 0] remaining members to acquire global barrier 2023-02-13 15:04:12,073 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 15:04:12,073 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,074 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,074 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,074 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,074 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:04:12,074 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 15:04:12,074 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 15:04:12,074 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 15:04:12,074 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,36557,1676300649086' in zk 2023-02-13 15:04:12,075 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 15:04:12,075 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 15:04:12,075 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,075 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. started... 2023-02-13 15:04:12,075 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ea81535be0674005983889a4f387f939 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 15:04:12,075 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 15:04:12,075 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:12,075 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 15:04:12,088 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f1/f9d68250590042f69aacee354f29e522 2023-02-13 15:04:12,103 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f2/9c7066c1e3524bf894f36d89b529cd85 2023-02-13 15:04:12,107 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f1/f9d68250590042f69aacee354f29e522 as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/f9d68250590042f69aacee354f29e522 2023-02-13 15:04:12,110 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/f9d68250590042f69aacee354f29e522, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:04:12,111 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f2/9c7066c1e3524bf894f36d89b529cd85 as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/9c7066c1e3524bf894f36d89b529cd85 2023-02-13 15:04:12,115 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/9c7066c1e3524bf894f36d89b529cd85, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 15:04:12,116 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ea81535be0674005983889a4f387f939 in 41ms, sequenceid=5, compaction requested=false 2023-02-13 15:04:12,116 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ea81535be0674005983889a4f387f939: 2023-02-13 15:04:12,116 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-13 15:04:12,116 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 15:04:12,116 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/f9d68250590042f69aacee354f29e522] hfiles 2023-02-13 15:04:12,116 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/f9d68250590042f69aacee354f29e522 for snapshot=testWithMapReduceSingleRegion 2023-02-13 15:04:12,116 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/9c7066c1e3524bf894f36d89b529cd85] hfiles 2023-02-13 15:04:12,116 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/9c7066c1e3524bf894f36d89b529cd85 for snapshot=testWithMapReduceSingleRegion 2023-02-13 15:04:12,125 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. completed. 2023-02-13 15:04:12,125 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,125 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 15:04:12,125 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 15:04:12,125 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,125 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 15:04:12,125 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,34595,1676300649119' in zk 2023-02-13 15:04:12,126 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,126 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 15:04:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:12,126 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:12,126 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 15:04:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 15:04:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 15:04:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,34595,1676300649119': 2023-02-13 15:04:12,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34595,1676300649119' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 15:04:12,128 INFO [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-13 15:04:12,128 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:04:12,128 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:04:12,128 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-13 15:04:12,129 INFO [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 15:04:12,129 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,129 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,129 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 15:04:12,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,129 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:12,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,129 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,130 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 15:04:12,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:12,130 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 15:04:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,131 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:12,132 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 15:04:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,162 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:12,162 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,162 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:12,162 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 15:04:12,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-13 15:04:12,162 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 15:04:12,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-13 15:04:12,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:12,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:12,162 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:12,163 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,162 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 15:04:12,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 15:04:12,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 15:04:12,163 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 15:04:12,163 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:12,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:12,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 15:04:12,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 15:04:12,163 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 15:04:12,163 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,163 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 15:04:12,163 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 15:04:12,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-13 15:04:12,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-13 15:04:12,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 15:04:12,201 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 15:04:12,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676300651109Consolidate snapshot: testWithMapReduceSingleRegion at 1676300652162 (+1053 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676300652163 (+1 ms)Writing data manifest for testWithMapReduceSingleRegion at 1676300652165 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676300652171 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676300652200 (+29 ms) 2023-02-13 15:04:12,204 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 15:04:12,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0940 sec 2023-02-13 15:04:12,220 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 15:04:12,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 15:04:12,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 15:04:12,222 INFO [Listener at localhost.localdomain/38593] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 15:04:12,226 INFO [Listener at localhost.localdomain/38593] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 15:04:12,231 INFO [Listener at localhost.localdomain/38593] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 15:04:12,338 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34595] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,413 INFO [Listener at localhost.localdomain/38593] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 15:04:12,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 15:04:12,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 15:04:12,419 INFO [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 15:04:12,419 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:12,419 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 15:04:12,419 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 15:04:12,420 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,420 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:04:12,421 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:12,421 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,421 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:12,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:12,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:12,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:12,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:12,421 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,421 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 15:04:12,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:04:12,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 15:04:12,422 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36557,1676300649086' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 15:04:12,423 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 15:04:12,423 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 15:04:12,423 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,423 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. started... 2023-02-13 15:04:12,423 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ea81535be0674005983889a4f387f939 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 15:04:12,423 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,423 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,423 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:12,437 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f1/d6d1fcb2c673417dbd435205e7f32aab 2023-02-13 15:04:12,453 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f2/db19c9df2d7a4017a5effb20b3523d9d 2023-02-13 15:04:12,457 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f1/d6d1fcb2c673417dbd435205e7f32aab as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/d6d1fcb2c673417dbd435205e7f32aab 2023-02-13 15:04:12,460 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/d6d1fcb2c673417dbd435205e7f32aab, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:04:12,461 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/.tmp/f2/db19c9df2d7a4017a5effb20b3523d9d as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/db19c9df2d7a4017a5effb20b3523d9d 2023-02-13 15:04:12,465 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/db19c9df2d7a4017a5effb20b3523d9d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 15:04:12,465 INFO [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ea81535be0674005983889a4f387f939 in 42ms, sequenceid=9, compaction requested=false 2023-02-13 15:04:12,465 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ea81535be0674005983889a4f387f939: 2023-02-13 15:04:12,465 DEBUG [rs(jenkins-hbase20.apache.org,34595,1676300649119)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,465 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 15:04:12,465 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 15:04:12,465 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,465 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 15:04:12,465 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34595,1676300649119' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 15:04:12,466 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,466 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:12,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:12,467 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,467 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 15:04:12,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:12,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:12,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:04:12,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:12,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34595,1676300649119' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 15:04:12,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b99d63e[Count = 0] remaining members to acquire global barrier 2023-02-13 15:04:12,468 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 15:04:12,468 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,469 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,469 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,469 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 15:04:12,469 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 15:04:12,469 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,469 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 15:04:12,469 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,34595,1676300649119' in zk 2023-02-13 15:04:12,469 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 15:04:12,469 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 15:04:12,469 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,36557,1676300649086' in zk 2023-02-13 15:04:12,470 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,470 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 15:04:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:12,470 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:12,470 DEBUG [member: 'jenkins-hbase20.apache.org,34595,1676300649119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 15:04:12,470 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 15:04:12,470 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:12,470 DEBUG [member: 'jenkins-hbase20.apache.org,36557,1676300649086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 15:04:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:12,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:04:12,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:12,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:04:12,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,34595,1676300649119': 2023-02-13 15:04:12,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34595,1676300649119' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 15:04:12,473 INFO [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 15:04:12,473 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 15:04:12,473 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 15:04:12,473 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 15:04:12,473 INFO [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 15:04:12,474 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:12,474 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 15:04:12,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,474 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 15:04:12,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:12,474 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:04:12,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 15:04:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:04:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,475 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 15:04:12,476 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 15:04:12,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:12,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:12,477 DEBUG [(jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 15:04:12,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 15:04:12,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 15:04:12,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 15:04:12,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 15:04:12,477 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 15:04:12,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:12,478 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:12,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:12,478 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,478 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:12,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 15:04:12,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 15:04:12,478 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 15:04:12,478 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 15:04:12,478 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 15:04:12,478 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 15:04:12,578 DEBUG [Listener at localhost.localdomain/38593] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 15:04:12,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 15:04:12,656 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/hadoop-2348955647862935143.jar 2023-02-13 15:04:12,659 INFO [Listener at localhost.localdomain/38593] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676300650859 type: FLUSH version: 2 ttl: 0 2023-02-13 15:04:12,659 DEBUG [Listener at localhost.localdomain/38593] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad/data/default/testWithMapReduce 2023-02-13 15:04:12,659 INFO [Listener at localhost.localdomain/38593] snapshot.RestoreSnapshotHelper(239): region to add: ea81535be0674005983889a4f387f939 2023-02-13 15:04:12,659 INFO [Listener at localhost.localdomain/38593] snapshot.RestoreSnapshotHelper(585): clone region=ea81535be0674005983889a4f387f939 as ea81535be0674005983889a4f387f939 in snapshot testWithMapReduceSingleRegion 2023-02-13 15:04:12,660 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ea81535be0674005983889a4f387f939, NAME => 'testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad 2023-02-13 15:04:12,664 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:12,665 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f9d68250590042f69aacee354f29e522 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 15:04:12,666 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c7066c1e3524bf894f36d89b529cd85 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 15:04:12,667 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ea81535be0674005983889a4f387f939, disabling compactions & flushes 2023-02-13 15:04:12,667 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,667 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,667 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. after waiting 0 ms 2023-02-13 15:04:12,667 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,667 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:12,667 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ea81535be0674005983889a4f387f939: Waiting for close lock at 1676300652667Disabling compacts and flushes for region at 1676300652667Disabling writes for close at 1676300652667Writing region close event to WAL at 1676300652667Closed at 1676300652667 2023-02-13 15:04:12,668 INFO [Listener at localhost.localdomain/38593] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676300650859 type: FLUSH version: 2 ttl: 0 2023-02-13 15:04:12,668 DEBUG [Listener at localhost.localdomain/38593] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad 2023-02-13 15:04:12,668 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad 2023-02-13 15:04:12,668 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(699): |-data/ 2023-02-13 15:04:12,668 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(699): |----default/ 2023-02-13 15:04:12,669 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 15:04:12,669 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(699): |----------ea81535be0674005983889a4f387f939/ 2023-02-13 15:04:12,669 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 15:04:12,669 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 15:04:12,669 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(702): |----------------testWithMapReduce=ea81535be0674005983889a4f387f939-f9d68250590042f69aacee354f29e522 2023-02-13 15:04:12,669 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 15:04:12,670 DEBUG [Listener at localhost.localdomain/38593] util.CommonFSUtils(702): |----------------testWithMapReduce=ea81535be0674005983889a4f387f939-9c7066c1e3524bf894f36d89b529cd85 2023-02-13 15:04:12,670 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,671 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,671 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,671 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,672 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,672 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,673 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,749 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/hadoop-3661743471316260455.jar 2023-02-13 15:04:12,750 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,750 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,750 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,751 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,751 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,751 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,752 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 15:04:12,752 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 15:04:12,753 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 15:04:12,753 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 15:04:12,753 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 15:04:12,754 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 15:04:12,754 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 15:04:12,754 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 15:04:12,755 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 15:04:12,755 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 15:04:12,755 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 15:04:12,755 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:04:12,756 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:04:12,756 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 15:04:12,756 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 15:04:12,820 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/hadoop-3142190826554767889.jar 2023-02-13 15:04:12,820 DEBUG [Listener at localhost.localdomain/38593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 15:04:12,825 WARN [Listener at localhost.localdomain/38593] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 15:04:12,858 INFO [Listener at localhost.localdomain/38593] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 15:04:12,928 WARN [Listener at localhost.localdomain/38593] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/mapreduce.cluster.local.dir/1676300652893/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 15:04:12,928 WARN [Listener at localhost.localdomain/38593] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/mapreduce.cluster.local.dir/1676300652893/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 15:04:12,957 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 15:04:12,958 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 15:04:12,958 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 15:04:12,960 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ea81535be0674005983889a4f387f939 2023-02-13 15:04:12,960 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1 2023-02-13 15:04:12,961 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea81535be0674005983889a4f387f939 columnFamilyName f1 2023-02-13 15:04:12,964 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/testWithMapReduce=ea81535be0674005983889a4f387f939-f9d68250590042f69aacee354f29e522 2023-02-13 15:04:12,964 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(310): Store=ea81535be0674005983889a4f387f939/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:12,964 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ea81535be0674005983889a4f387f939 2023-02-13 15:04:12,965 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2 2023-02-13 15:04:12,966 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea81535be0674005983889a4f387f939 columnFamilyName f2 2023-02-13 15:04:12,968 DEBUG [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38845/user/jenkins/test-data/ce61dab9-cc4f-3496-c568-f5e2905060bf/testWithMapReduceSingleRegion/e5c47486-d460-4835-9540-7ebfc8c738ad/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/testWithMapReduce=ea81535be0674005983889a4f387f939-9c7066c1e3524bf894f36d89b529cd85 2023-02-13 15:04:12,969 INFO [StoreOpener-ea81535be0674005983889a4f387f939-1] regionserver.HStore(310): Store=ea81535be0674005983889a4f387f939/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 15:04:12,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 15:04:12,969 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ea81535be0674005983889a4f387f939; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75106303, jitterRate=0.1191711276769638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 15:04:12,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ea81535be0674005983889a4f387f939: Writing region info on filesystem at 1676300652958Initializing all the Stores at 1676300652959 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300652959Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676300652959Region opened successfully at 1676300652969 (+10 ms) 2023-02-13 15:04:13,044 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ea81535be0674005983889a4f387f939, disabling compactions & flushes 2023-02-13 15:04:13,044 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:13,044 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:13,044 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. after waiting 0 ms 2023-02-13 15:04:13,044 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:13,045 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:13,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ea81535be0674005983889a4f387f939: Waiting for close lock at 1676300653044Disabling compacts and flushes for region at 1676300653044Disabling writes for close at 1676300653044Writing region close event to WAL at 1676300653045 (+1 ms)Closed at 1676300653045 2023-02-13 15:04:13,864 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:04:13,864 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 15:04:13,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceSingleRegion" 2023-02-13 15:04:13,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-13 15:04:13,963 INFO [Listener at localhost.localdomain/38593] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 15:04:13,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-13 15:04:13,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 15:04:13,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:13,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300653966"}]},"ts":"1676300653966"} 2023-02-13 15:04:13,967 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 15:04:13,968 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 15:04:13,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ea81535be0674005983889a4f387f939, UNASSIGN}] 2023-02-13 15:04:13,970 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ea81535be0674005983889a4f387f939, UNASSIGN 2023-02-13 15:04:13,971 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ea81535be0674005983889a4f387f939, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:13,971 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676300653971"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676300653971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676300653971"}]},"ts":"1676300653971"} 2023-02-13 15:04:13,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ea81535be0674005983889a4f387f939, server=jenkins-hbase20.apache.org,34595,1676300649119}] 2023-02-13 15:04:14,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:14,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close ea81535be0674005983889a4f387f939 2023-02-13 15:04:14,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing ea81535be0674005983889a4f387f939, disabling compactions & flushes 2023-02-13 15:04:14,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:14,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:14,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. after waiting 0 ms 2023-02-13 15:04:14,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:14,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 15:04:14,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939. 2023-02-13 15:04:14,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for ea81535be0674005983889a4f387f939: Waiting for close lock at 1676300654124Running coprocessor pre-close hooks at 1676300654124Disabling compacts and flushes for region at 1676300654124Disabling writes for close at 1676300654124Writing region close event to WAL at 1676300654125 (+1 ms)Running coprocessor post-close hooks at 1676300654128 (+3 ms)Closed at 1676300654128 2023-02-13 15:04:14,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed ea81535be0674005983889a4f387f939 2023-02-13 15:04:14,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ea81535be0674005983889a4f387f939, regionState=CLOSED 2023-02-13 15:04:14,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676300654130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676300654130"}]},"ts":"1676300654130"} 2023-02-13 15:04:14,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 15:04:14,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ea81535be0674005983889a4f387f939, server=jenkins-hbase20.apache.org,34595,1676300649119 in 160 msec 2023-02-13 15:04:14,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 15:04:14,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ea81535be0674005983889a4f387f939, UNASSIGN in 164 msec 2023-02-13 15:04:14,134 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676300654134"}]},"ts":"1676300654134"} 2023-02-13 15:04:14,135 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 15:04:14,136 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 15:04:14,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 174 msec 2023-02-13 15:04:14,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 15:04:14,269 INFO [Listener at localhost.localdomain/38593] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-13 15:04:14,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-13 15:04:14,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:04:14,272 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:04:14,272 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:04:14,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:04:14,275 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939 2023-02-13 15:04:14,276 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1, FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2, FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/recovered.edits] 2023-02-13 15:04:14,279 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/d6d1fcb2c673417dbd435205e7f32aab to hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/archive/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/d6d1fcb2c673417dbd435205e7f32aab 2023-02-13 15:04:14,280 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/f9d68250590042f69aacee354f29e522 to hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/archive/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f1/f9d68250590042f69aacee354f29e522 2023-02-13 15:04:14,282 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/9c7066c1e3524bf894f36d89b529cd85 to hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/archive/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/9c7066c1e3524bf894f36d89b529cd85 2023-02-13 15:04:14,283 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/db19c9df2d7a4017a5effb20b3523d9d to hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/archive/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/f2/db19c9df2d7a4017a5effb20b3523d9d 2023-02-13 15:04:14,286 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/recovered.edits/12.seqid to hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/archive/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939/recovered.edits/12.seqid 2023-02-13 15:04:14,286 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/.tmp/data/default/testWithMapReduce/ea81535be0674005983889a4f387f939 2023-02-13 15:04:14,286 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 15:04:14,288 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:04:14,289 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-13 15:04:14,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 15:04:14,292 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:04:14,292 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 15:04:14,292 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676300654292"}]},"ts":"9223372036854775807"} 2023-02-13 15:04:14,294 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 15:04:14,294 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ea81535be0674005983889a4f387f939, NAME => 'testWithMapReduce,,1676300650151.ea81535be0674005983889a4f387f939.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 15:04:14,294 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 15:04:14,294 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676300654294"}]},"ts":"9223372036854775807"} 2023-02-13 15:04:14,295 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 15:04:14,297 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 15:04:14,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-13 15:04:14,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41393] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 15:04:14,374 INFO [Listener at localhost.localdomain/38593] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-13 15:04:14,375 INFO [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 15:04:14,375 INFO [Listener at localhost.localdomain/38593] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 15:04:14,375 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e250560 to 127.0.0.1:58606 2023-02-13 15:04:14,375 DEBUG [Listener at localhost.localdomain/38593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:14,375 DEBUG [Listener at localhost.localdomain/38593] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 15:04:14,375 DEBUG [Listener at localhost.localdomain/38593] util.JVMClusterUtil(257): Found active master hash=1909154802, stopped=false 2023-02-13 15:04:14,375 INFO [Listener at localhost.localdomain/38593] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:14,376 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:14,376 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:14,376 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:14,376 INFO [Listener at localhost.localdomain/38593] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 15:04:14,376 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 15:04:14,377 DEBUG [Listener at localhost.localdomain/38593] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b9dbe42 to 127.0.0.1:58606 2023-02-13 15:04:14,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:14,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:14,377 DEBUG [Listener at localhost.localdomain/38593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:14,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 15:04:14,378 INFO [Listener at localhost.localdomain/38593] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,36557,1676300649086' ***** 2023-02-13 15:04:14,378 INFO [Listener at localhost.localdomain/38593] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:04:14,378 INFO [Listener at localhost.localdomain/38593] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34595,1676300649119' ***** 2023-02-13 15:04:14,378 INFO [Listener at localhost.localdomain/38593] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 15:04:14,378 INFO [RS:0;jenkins-hbase20:36557] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:04:14,378 INFO [RS:1;jenkins-hbase20:34595] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 15:04:14,378 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:04:14,378 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 15:04:14,378 INFO [RS:0;jenkins-hbase20:36557] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:04:14,378 INFO [RS:1;jenkins-hbase20:34595] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 15:04:14,379 INFO [RS:0;jenkins-hbase20:36557] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:04:14,379 INFO [RS:1;jenkins-hbase20:34595] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 15:04:14,380 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(3304): Received CLOSE for f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:14,380 INFO [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:14,380 DEBUG [RS:1;jenkins-hbase20:34595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x345468f4 to 127.0.0.1:58606 2023-02-13 15:04:14,380 DEBUG [RS:1;jenkins-hbase20:34595] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:14,380 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:14,380 INFO [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34595,1676300649119; all regions closed. 2023-02-13 15:04:14,380 DEBUG [RS:0;jenkins-hbase20:36557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375232d4 to 127.0.0.1:58606 2023-02-13 15:04:14,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f926c3fe1a319b34a03c84f5ad13cde0, disabling compactions & flushes 2023-02-13 15:04:14,380 DEBUG [RS:0;jenkins-hbase20:36557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:14,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:14,380 INFO [RS:0;jenkins-hbase20:36557] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:04:14,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:14,380 INFO [RS:0;jenkins-hbase20:36557] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:04:14,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. after waiting 0 ms 2023-02-13 15:04:14,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:14,380 INFO [RS:0;jenkins-hbase20:36557] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:04:14,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing f926c3fe1a319b34a03c84f5ad13cde0 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 15:04:14,380 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 15:04:14,380 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 15:04:14,380 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, f926c3fe1a319b34a03c84f5ad13cde0=hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0.} 2023-02-13 15:04:14,381 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 15:04:14,381 DEBUG [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1505): Waiting on 1588230740, f926c3fe1a319b34a03c84f5ad13cde0 2023-02-13 15:04:14,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 15:04:14,381 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 15:04:14,381 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 15:04:14,381 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 15:04:14,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.71 KB heapSize=7.12 KB 2023-02-13 15:04:14,383 DEBUG [RS:1;jenkins-hbase20:34595] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/oldWALs 2023-02-13 15:04:14,383 INFO [RS:1;jenkins-hbase20:34595] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34595%2C1676300649119:(num 1676300650414) 2023-02-13 15:04:14,383 DEBUG [RS:1;jenkins-hbase20:34595] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:14,383 INFO [RS:1;jenkins-hbase20:34595] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:14,383 INFO [RS:1;jenkins-hbase20:34595] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 15:04:14,383 INFO [RS:1;jenkins-hbase20:34595] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 15:04:14,383 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:14,383 INFO [RS:1;jenkins-hbase20:34595] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 15:04:14,383 INFO [RS:1;jenkins-hbase20:34595] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 15:04:14,384 INFO [RS:1;jenkins-hbase20:34595] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34595 2023-02-13 15:04:14,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/.tmp/info/e2b4c115d44c4a2e916410d5788e3cc4 2023-02-13 15:04:14,394 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:14,394 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34595,1676300649119 2023-02-13 15:04:14,394 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c29a10f rejected from java.util.concurrent.ThreadPoolExecutor@38163252[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:14,394 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:14,394 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:14,394 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d73dafd rejected from java.util.concurrent.ThreadPoolExecutor@38163252[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:14,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2b4c115d44c4a2e916410d5788e3cc4 2023-02-13 15:04:14,394 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:14,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/.tmp/info/abd802f3f3a04396a4570514bad6c0c8 2023-02-13 15:04:14,397 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34595,1676300649119] 2023-02-13 15:04:14,397 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34595,1676300649119; numProcessing=1 2023-02-13 15:04:14,399 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34595,1676300649119 already deleted, retry=false 2023-02-13 15:04:14,399 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34595,1676300649119 expired; onlineServers=1 2023-02-13 15:04:14,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/.tmp/info/abd802f3f3a04396a4570514bad6c0c8 as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/info/abd802f3f3a04396a4570514bad6c0c8 2023-02-13 15:04:14,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/info/abd802f3f3a04396a4570514bad6c0c8, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 15:04:14,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f926c3fe1a319b34a03c84f5ad13cde0 in 26ms, sequenceid=6, compaction requested=false 2023-02-13 15:04:14,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/.tmp/rep_barrier/92688ec0326947c18d0bf7a47d031861 2023-02-13 15:04:14,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/namespace/f926c3fe1a319b34a03c84f5ad13cde0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 15:04:14,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:14,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f926c3fe1a319b34a03c84f5ad13cde0: Waiting for close lock at 1676300654380Running coprocessor pre-close hooks at 1676300654380Disabling compacts and flushes for region at 1676300654380Disabling writes for close at 1676300654380Obtaining lock to block concurrent updates at 1676300654380Preparing flush snapshotting stores in f926c3fe1a319b34a03c84f5ad13cde0 at 1676300654380Finished memstore snapshotting hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676300654380Flushing stores of hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. at 1676300654381 (+1 ms)Flushing f926c3fe1a319b34a03c84f5ad13cde0/info: creating writer at 1676300654381Flushing f926c3fe1a319b34a03c84f5ad13cde0/info: appending metadata at 1676300654383 (+2 ms)Flushing f926c3fe1a319b34a03c84f5ad13cde0/info: closing flushed file at 1676300654383Flushing f926c3fe1a319b34a03c84f5ad13cde0/info: reopening flushed file at 1676300654401 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f926c3fe1a319b34a03c84f5ad13cde0 in 26ms, sequenceid=6, compaction requested=false at 1676300654406 (+5 ms)Writing region close event to WAL at 1676300654407 (+1 ms)Running coprocessor post-close hooks at 1676300654410 (+3 ms)Closed at 1676300654410 2023-02-13 15:04:14,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676300649666.f926c3fe1a319b34a03c84f5ad13cde0. 2023-02-13 15:04:14,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92688ec0326947c18d0bf7a47d031861 2023-02-13 15:04:14,412 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:14,412 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:14,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/.tmp/table/df04af5398704f8f9f37fb1293fd36bc 2023-02-13 15:04:14,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df04af5398704f8f9f37fb1293fd36bc 2023-02-13 15:04:14,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/.tmp/info/e2b4c115d44c4a2e916410d5788e3cc4 as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/info/e2b4c115d44c4a2e916410d5788e3cc4 2023-02-13 15:04:14,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2b4c115d44c4a2e916410d5788e3cc4 2023-02-13 15:04:14,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/info/e2b4c115d44c4a2e916410d5788e3cc4, entries=12, sequenceid=21, filesize=6.2 K 2023-02-13 15:04:14,428 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/.tmp/rep_barrier/92688ec0326947c18d0bf7a47d031861 as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/rep_barrier/92688ec0326947c18d0bf7a47d031861 2023-02-13 15:04:14,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92688ec0326947c18d0bf7a47d031861 2023-02-13 15:04:14,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/rep_barrier/92688ec0326947c18d0bf7a47d031861, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 15:04:14,432 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/.tmp/table/df04af5398704f8f9f37fb1293fd36bc as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/table/df04af5398704f8f9f37fb1293fd36bc 2023-02-13 15:04:14,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df04af5398704f8f9f37fb1293fd36bc 2023-02-13 15:04:14,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/table/df04af5398704f8f9f37fb1293fd36bc, entries=4, sequenceid=21, filesize=5.0 K 2023-02-13 15:04:14,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.71 KB/3794, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false 2023-02-13 15:04:14,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 15:04:14,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 15:04:14,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:14,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676300654381Running coprocessor pre-close hooks at 1676300654381Disabling compacts and flushes for region at 1676300654381Disabling writes for close at 1676300654381Obtaining lock to block concurrent updates at 1676300654381Preparing flush snapshotting stores in 1588230740 at 1676300654381Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3794, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676300654381Flushing stores of hbase:meta,,1.1588230740 at 1676300654381Flushing 1588230740/info: creating writer at 1676300654381Flushing 1588230740/info: appending metadata at 1676300654383 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676300654383Flushing 1588230740/rep_barrier: creating writer at 1676300654395 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676300654396 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676300654396Flushing 1588230740/table: creating writer at 1676300654412 (+16 ms)Flushing 1588230740/table: appending metadata at 1676300654415 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676300654415Flushing 1588230740/info: reopening flushed file at 1676300654424 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676300654428 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676300654433 (+5 ms)Finished flush of dataSize ~3.71 KB/3794, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false at 1676300654437 (+4 ms)Writing region close event to WAL at 1676300654438 (+1 ms)Running coprocessor post-close hooks at 1676300654440 (+2 ms)Closed at 1676300654440 2023-02-13 15:04:14,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 15:04:14,471 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 15:04:14,471 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 15:04:14,576 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:14,576 INFO [RS:1;jenkins-hbase20:34595] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34595,1676300649119; zookeeper connection closed. 2023-02-13 15:04:14,576 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@452e1ae1 rejected from java.util.concurrent.ThreadPoolExecutor@38163252[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:14,576 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1a26ad1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1a26ad1 2023-02-13 15:04:14,576 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:34595-0x1015c5dc3f10002, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:14,577 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ebcc113 rejected from java.util.concurrent.ThreadPoolExecutor@38163252[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:14,581 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,36557,1676300649086; all regions closed. 2023-02-13 15:04:14,584 DEBUG [RS:0;jenkins-hbase20:36557] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/oldWALs 2023-02-13 15:04:14,585 INFO [RS:0;jenkins-hbase20:36557] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36557%2C1676300649086.meta:.meta(num 1676300649614) 2023-02-13 15:04:14,588 DEBUG [RS:0;jenkins-hbase20:36557] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/oldWALs 2023-02-13 15:04:14,588 INFO [RS:0;jenkins-hbase20:36557] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36557%2C1676300649086:(num 1676300650004) 2023-02-13 15:04:14,588 DEBUG [RS:0;jenkins-hbase20:36557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:14,588 INFO [RS:0;jenkins-hbase20:36557] regionserver.LeaseManager(133): Closed leases 2023-02-13 15:04:14,588 INFO [RS:0;jenkins-hbase20:36557] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 15:04:14,588 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:14,591 INFO [RS:0;jenkins-hbase20:36557] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36557 2023-02-13 15:04:14,592 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,36557,1676300649086 2023-02-13 15:04:14,592 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 15:04:14,592 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e240e0b rejected from java.util.concurrent.ThreadPoolExecutor@1a1b9917[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:14,592 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,36557,1676300649086] 2023-02-13 15:04:14,592 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,36557,1676300649086; numProcessing=2 2023-02-13 15:04:14,593 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,36557,1676300649086 already deleted, retry=false 2023-02-13 15:04:14,593 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,36557,1676300649086 expired; onlineServers=0 2023-02-13 15:04:14,593 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41393,1676300649043' ***** 2023-02-13 15:04:14,593 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 15:04:14,594 DEBUG [M:0;jenkins-hbase20:41393] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75f4f913, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 15:04:14,594 INFO [M:0;jenkins-hbase20:41393] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41393,1676300649043 2023-02-13 15:04:14,594 INFO [M:0;jenkins-hbase20:41393] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41393,1676300649043; all regions closed. 2023-02-13 15:04:14,594 DEBUG [M:0;jenkins-hbase20:41393] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 15:04:14,594 DEBUG [M:0;jenkins-hbase20:41393] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 15:04:14,594 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 15:04:14,594 DEBUG [M:0;jenkins-hbase20:41393] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 15:04:14,594 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300649264] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676300649264,5,FailOnTimeoutGroup] 2023-02-13 15:04:14,594 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300649263] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676300649263,5,FailOnTimeoutGroup] 2023-02-13 15:04:14,594 INFO [M:0;jenkins-hbase20:41393] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 15:04:14,596 INFO [M:0;jenkins-hbase20:41393] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 15:04:14,596 INFO [M:0;jenkins-hbase20:41393] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 15:04:14,596 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 15:04:14,596 DEBUG [M:0;jenkins-hbase20:41393] master.HMaster(1502): Stopping service threads 2023-02-13 15:04:14,596 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 15:04:14,596 INFO [M:0;jenkins-hbase20:41393] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 15:04:14,597 ERROR [M:0;jenkins-hbase20:41393] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 15:04:14,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 15:04:14,597 INFO [M:0;jenkins-hbase20:41393] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 15:04:14,597 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 15:04:14,597 DEBUG [M:0;jenkins-hbase20:41393] zookeeper.ZKUtil(398): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 15:04:14,597 WARN [M:0;jenkins-hbase20:41393] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 15:04:14,597 INFO [M:0;jenkins-hbase20:41393] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 15:04:14,598 INFO [M:0;jenkins-hbase20:41393] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 15:04:14,598 DEBUG [M:0;jenkins-hbase20:41393] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 15:04:14,598 INFO [M:0;jenkins-hbase20:41393] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:14,598 DEBUG [M:0;jenkins-hbase20:41393] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:14,598 DEBUG [M:0;jenkins-hbase20:41393] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 15:04:14,598 DEBUG [M:0;jenkins-hbase20:41393] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:14,598 INFO [M:0;jenkins-hbase20:41393] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.74 KB heapSize=65.73 KB 2023-02-13 15:04:14,608 INFO [M:0;jenkins-hbase20:41393] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.74 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2f5cdb565e9448a0875b0bbbd7038666 2023-02-13 15:04:14,612 DEBUG [M:0;jenkins-hbase20:41393] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2f5cdb565e9448a0875b0bbbd7038666 as hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2f5cdb565e9448a0875b0bbbd7038666 2023-02-13 15:04:14,615 INFO [M:0;jenkins-hbase20:41393] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38845/user/jenkins/test-data/3c15c83e-8e2f-996d-79b0-0d83e9ca2abd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2f5cdb565e9448a0875b0bbbd7038666, entries=17, sequenceid=132, filesize=8.6 K 2023-02-13 15:04:14,615 INFO [M:0;jenkins-hbase20:41393] regionserver.HRegion(2947): Finished flush of dataSize ~54.74 KB/56052, heapSize ~65.71 KB/67288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-13 15:04:14,616 INFO [M:0;jenkins-hbase20:41393] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 15:04:14,616 DEBUG [M:0;jenkins-hbase20:41393] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676300654598Disabling compacts and flushes for region at 1676300654598Disabling writes for close at 1676300654598Obtaining lock to block concurrent updates at 1676300654598Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676300654598Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56052, getHeapSize=67288, getOffHeapSize=0, getCellsCount=145 at 1676300654598Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676300654599 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676300654599Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676300654601 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676300654601Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676300654612 (+11 ms)Finished flush of dataSize ~54.74 KB/56052, heapSize ~65.71 KB/67288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676300654615 (+3 ms)Writing region close event to WAL at 1676300654616 (+1 ms)Closed at 1676300654616 2023-02-13 15:04:14,618 INFO [M:0;jenkins-hbase20:41393] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 15:04:14,618 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 15:04:14,618 INFO [M:0;jenkins-hbase20:41393] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41393 2023-02-13 15:04:14,619 DEBUG [M:0;jenkins-hbase20:41393] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,41393,1676300649043 already deleted, retry=false 2023-02-13 15:04:14,978 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:14,978 INFO [M:0;jenkins-hbase20:41393] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41393,1676300649043; zookeeper connection closed. 2023-02-13 15:04:14,978 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2dbaa7d2 rejected from java.util.concurrent.ThreadPoolExecutor@298526bd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:14,979 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): master:41393-0x1015c5dc3f10000, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:14,979 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25dd9691 rejected from java.util.concurrent.ThreadPoolExecutor@298526bd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:15,078 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:15,078 INFO [RS:0;jenkins-hbase20:36557] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,36557,1676300649086; zookeeper connection closed. 2023-02-13 15:04:15,078 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5066a57e rejected from java.util.concurrent.ThreadPoolExecutor@1a1b9917[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:15,078 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7099a587] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7099a587 2023-02-13 15:04:15,078 DEBUG [Listener at localhost.localdomain/38593-EventThread] zookeeper.ZKWatcher(600): regionserver:36557-0x1015c5dc3f10001, quorum=127.0.0.1:58606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 15:04:15,079 ERROR [Listener at localhost.localdomain/38593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@281942c8 rejected from java.util.concurrent.ThreadPoolExecutor@1a1b9917[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 15:04:15,079 INFO [Listener at localhost.localdomain/38593] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 15:04:15,079 WARN [Listener at localhost.localdomain/38593] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:04:15,084 INFO [Listener at localhost.localdomain/38593] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:04:15,132 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 15:04:15,258 WARN [BP-1894851063-148.251.75.209-1676300648550 heartbeating to localhost.localdomain/127.0.0.1:38845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:04:15,258 WARN [BP-1894851063-148.251.75.209-1676300648550 heartbeating to localhost.localdomain/127.0.0.1:38845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1894851063-148.251.75.209-1676300648550 (Datanode Uuid dc649e29-8b43-46bc-a26b-e793db8509db) service to localhost.localdomain/127.0.0.1:38845 2023-02-13 15:04:15,259 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba/dfs/data/data3/current/BP-1894851063-148.251.75.209-1676300648550] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:15,259 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba/dfs/data/data4/current/BP-1894851063-148.251.75.209-1676300648550] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:15,261 WARN [Listener at localhost.localdomain/38593] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 15:04:15,264 INFO [Listener at localhost.localdomain/38593] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 15:04:15,365 WARN [BP-1894851063-148.251.75.209-1676300648550 heartbeating to localhost.localdomain/127.0.0.1:38845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 15:04:15,365 WARN [BP-1894851063-148.251.75.209-1676300648550 heartbeating to localhost.localdomain/127.0.0.1:38845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1894851063-148.251.75.209-1676300648550 (Datanode Uuid 08085199-bc47-470d-835b-643814e730c6) service to localhost.localdomain/127.0.0.1:38845 2023-02-13 15:04:15,366 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba/dfs/data/data1/current/BP-1894851063-148.251.75.209-1676300648550] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:15,366 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70670f75-3da5-e52a-e361-e64ddc55c820/cluster_16dee6f6-bd83-a8fc-396f-7fd56a2128ba/dfs/data/data2/current/BP-1894851063-148.251.75.209-1676300648550] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 15:04:15,377 INFO [Listener at localhost.localdomain/38593] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 15:04:15,493 INFO [Listener at localhost.localdomain/38593] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 15:04:15,518 INFO [Listener at localhost.localdomain/38593] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 15:04:15,545 INFO [Listener at localhost.localdomain/38593] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 278) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:38845 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:38845 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost.localdomain:38845 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:38845 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2126799157) connection to localhost.localdomain/127.0.0.1:38845 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost.localdomain:38845 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,41393,1676300649043)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/38593 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:38845 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=608 (was 586) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 244), ProcessCount=163 (was 164), AvailableMemoryMB=6714 (was 6834)